[ 623.879014] env[65811]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 623.879014] env[65811]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 624.898013] env[65899]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 624.898013] env[65899]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 626.740953] env[65899]: INFO neutron.common.config [-] Logging enabled! [ 626.741365] env[65899]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.1.0.dev61 [ 626.741530] env[65899]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65899) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 626.741838] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 626.741935] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 626.742785] env[65899]: WARNING oslo_policy.policy [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 626.743093] env[65899]: WARNING oslo_policy.policy [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 626.744746] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] VMware NSXv3 Agent initialized successfully. [ 626.745112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] Acquiring lock "singleton_lock" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.745244] env[65899]: DEBUG oslo_concurrency.lockutils [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] Acquired lock "singleton_lock" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.745443] env[65899]: DEBUG oslo_concurrency.lockutils [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] Releasing lock "singleton_lock" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.745740] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] Full set of CONF: {{(pid=65899) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 626.745879] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ******************************************************************************** {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 626.745953] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] Configuration options gathered from: {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 626.746614] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 626.746793] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 626.746905] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ================================================================================ {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 626.747085] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] agent_down_time = 75 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.747240] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] allow_automatic_dhcp_failover = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.747363] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] allow_bulk = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.747523] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] api_extensions_path = {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.747675] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] api_paste_config = api-paste.ini {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.747812] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] auth_strategy = keystone {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.747919] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] backdoor_port = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.748029] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] backdoor_socket = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.748168] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] backlog = 4096 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.748305] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] base_mac = fa:16:3e:00:00:00 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.748458] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] bind_host = 0.0.0.0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.748618] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] bind_port = 9696 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.748723] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] client_socket_timeout = 900 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.748860] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] config_dir = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.748967] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.749112] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] config_source = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.749248] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] control_exchange = neutron {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.749382] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] core_plugin = ml2 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.749515] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] debug = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.749645] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] default_availability_zones = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.749843] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.749978] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] dhcp_agent_notification = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.750122] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] dhcp_agents_per_network = 1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.750252] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] dhcp_lease_duration = 86400 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.750390] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] dhcp_load_type = networks {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.750541] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] dns_domain = openstacklocal {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.750693] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.750843] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] enable_default_route_bfd = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.750977] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] enable_default_route_ecmp = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.751120] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] enable_dvr = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.751250] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] enable_new_agents = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.751377] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.751504] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] enable_signals = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.751630] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] enable_traditional_dhcp = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.751762] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] external_dns_driver = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.751903] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] filter_validation = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.752057] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] global_physnet_mtu = 8950 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.752191] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] graceful_shutdown_timeout = 60 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.752367] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] host = cpu-1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.752503] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] host_dvr_for_dhcp = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.752633] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] http_retries = 3 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.752767] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] instance_format = [instance: %(uuid)s] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.752899] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.753041] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ipam_driver = internal {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.753174] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ipv6_pd_enabled = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.753300] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] l3_ha = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.753432] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.753587] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] l3_ha_network_physical_name = {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.753730] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] l3_ha_network_type = {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.753864] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_color = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.753998] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_config_append = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.754144] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.754273] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_dir = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.754402] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_file = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.754560] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_options = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.754743] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_rotate_interval = 1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.754900] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_rotate_interval_type = days {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.755049] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] log_rotation_type = none {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.755155] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.755256] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.755391] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.755525] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.755626] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.755814] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] max_dns_nameservers = 5 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.755962] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] max_header_line = 16384 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.756106] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] max_l3_agents_per_router = 3 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.756237] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] max_logfile_count = 30 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.756366] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] max_logfile_size_mb = 200 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.756510] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] max_subnet_host_routes = 20 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.756666] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] my_ip = 10.180.1.21 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.756802] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] my_ipv6 = ::1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.756933] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] network_auto_schedule = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.757068] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] network_link_prefix = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.757208] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.757344] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] notify_nova_on_port_data_changes = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.757540] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] notify_nova_on_port_status_changes = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.757734] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] pagination_max_limit = -1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.757875] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] publish_errors = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.758022] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] rate_limit_burst = 0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.758155] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] rate_limit_except_level = CRITICAL {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.758281] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] rate_limit_interval = 0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.758409] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] retry_until_window = 30 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.758534] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] router_distributed = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.758706] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] rpc_resources_processing_step = 20 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.758852] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] rpc_response_max_timeout = 600 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.758984] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] rpc_response_timeout = 60 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.759126] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] send_events_interval = 2 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.759271] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] service_plugins = ['router'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.759406] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] setproctitle = on {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.759530] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] shell_completion = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.759662] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] state_path = /opt/stack/data/neutron {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.759793] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] syslog_log_facility = LOG_USER {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.759924] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] tcp_keepidle = 600 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.760067] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] transport_url = **** {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.760194] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] use_journal = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.760318] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] use_json = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.760442] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] use_ssl = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.760566] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] use_stderr = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.760696] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] use_syslog = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.760858] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] vlan_qinq = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.760990] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] vlan_transparent = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.761128] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] watch_log_file = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.761258] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] wsgi_default_pool_size = 100 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.761387] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] wsgi_keep_alive = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.761520] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.761649] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] wsgi_server_debug = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 626.761818] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_concurrency.disable_process_locking = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.761962] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.762115] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.762246] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.762382] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.762517] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.762648] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.762794] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.connection_string = messaging:// {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.762933] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.enabled = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.763081] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.es_doc_type = notification {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.763211] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.es_scroll_size = 10000 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.763346] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.es_scroll_time = 2m {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.763477] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.filter_error_trace = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.763610] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.hmac_keys = **** {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.763745] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.sentinel_service_name = mymaster {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.763888] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.socket_timeout = 0.1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.764030] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.trace_requests = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.764164] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler.trace_sqlalchemy = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.764307] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler_jaeger.process_tags = {} {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.764437] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler_jaeger.service_name_prefix = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.764569] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] profiler_otlp.service_name_prefix = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.764738] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.enforce_new_defaults = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.765054] env[65899]: WARNING oslo_config.cfg [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 626.765210] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.enforce_scope = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.765353] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.policy_default_rule = default {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.765502] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.765640] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.765781] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.765915] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.766059] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.766189] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.766319] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.766456] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_policy.remote_timeout = 60.0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.766601] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.766744] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] agent.extensions = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.766883] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.767030] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] service_providers.service_provider = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.767175] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.default_quota = -1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.767314] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.767444] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_floatingip = 50 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.767575] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_network = 100 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.767718] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_port = 500 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.767874] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.768025] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_router = 10 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.768161] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_security_group = 10 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.768294] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.768424] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.quota_subnet = 100 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.768554] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] QUOTAS.track_quota_usage = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.768715] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.768856] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep.group = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.768986] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep.helper_command = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.769130] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep.log_daemon_traceback = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.769265] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.769400] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep.thread_pool_size = 8 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.769528] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep.user = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.769668] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.769796] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_dhcp_release.group = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.769925] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_dhcp_release.helper_command = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.770064] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.770199] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.770330] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.770455] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_dhcp_release.user = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.770592] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.770721] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_ovs_vsctl.group = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.770889] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_ovs_vsctl.helper_command = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.771038] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.771177] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.771310] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.771439] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_ovs_vsctl.user = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.771574] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_namespace.capabilities = [21] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.771701] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_namespace.group = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.771830] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_namespace.helper_command = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.771961] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_namespace.log_daemon_traceback = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.772107] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.772238] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_namespace.thread_pool_size = 8 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.772366] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_namespace.user = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.772500] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_conntrack.capabilities = [12] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.772624] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_conntrack.group = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.772751] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_conntrack.helper_command = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.772882] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.773020] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.773153] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.773278] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_conntrack.user = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.773412] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_link.capabilities = [12, 21] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.773539] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_link.group = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.773662] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_link.helper_command = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.773813] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_link.log_daemon_traceback = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.773961] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.774105] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_link.thread_pool_size = 8 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.774232] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] privsep_link.user = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.774380] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.774523] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.774658] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.continue_on_failed_promotions = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.774788] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.dscp = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.774923] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.dscp_inherit = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.775072] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.force_mp_to_policy = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.775202] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.locking_coordinator_url = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.775330] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.log_agent_heartbeats = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.775460] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.logging_expire = 1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.775597] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.775728] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.775866] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.polling_interval = 240 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.776009] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.776151] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.776289] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.report_interval = 30.0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.776425] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.776559] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.776694] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.776864] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.sync_skew = 60 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.777033] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.synchronization_queue_size = 20 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.777175] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT.use_helper_for_ns_read = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.777317] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] SECURITYGROUP.enable_ipset = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.777458] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] SECURITYGROUP.enable_security_group = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.777596] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.777734] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.777873] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] experimental.ipv6_pd_enabled = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.778039] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.extension_drivers = ['port_security'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.778173] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.external_network_type = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.778321] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.778463] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.overlay_ip_version = 4 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.778601] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.path_mtu = 8950 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.778744] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.physical_network_mtus = {} {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.778888] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.tenant_network_types = ['vlan'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.779036] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.779181] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ml2.type_drivers = ['vlan'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.779324] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT_CLI.neutron_port_id = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.779457] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.779589] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.779752] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.779923] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.780081] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.780221] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.780359] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.780498] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.780691] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.780868] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_login_password = **** {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.781024] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_login_port = 443 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.781167] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_login_user = admin {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.781306] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.781444] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.781577] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.781707] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.781843] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.781987] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.782137] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.782275] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.782410] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.782548] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.782690] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.782847] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.783022] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.783208] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.783353] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] vsphere.vsphere_login_password = VMware1! {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.783490] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.783624] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.783763] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.auth_section = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.783909] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.auth_type = password {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.784059] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.784191] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.certfile = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.784324] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.collect_timing = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.784546] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.endpoint_type = public {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.784697] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.insecure = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.784827] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.keyfile = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.784971] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.region_name = RegionOne {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.785117] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.split_loggers = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.785248] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] nova.timeout = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.785387] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.auth_section = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.785529] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.auth_type = password {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.785667] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.785795] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.certfile = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.785952] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.collect_timing = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.786107] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.endpoint_type = public {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.786241] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.insecure = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.786366] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.keyfile = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.786493] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.region_name = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.786621] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.split_loggers = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.786747] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] placement.timeout = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.786883] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.auth_section = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.787027] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.auth_type = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.787158] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.cafile = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.787285] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.certfile = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.787418] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.collect_timing = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.787546] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.connect_retries = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.787673] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.connect_retry_delay = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.787802] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.enable_notifications = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.787929] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.endpoint_override = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.788069] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.insecure = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.788198] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.interface = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.788326] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.keyfile = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.788457] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.max_version = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.788583] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.min_version = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.788735] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.region_name = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.788896] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.retriable_status_codes = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.789049] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.service_name = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.789184] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.service_type = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.789314] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.split_loggers = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.789443] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.status_code_retries = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.789569] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.status_code_retry_delay = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.789696] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.timeout = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.789825] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.valid_interfaces = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.789954] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ironic.version = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.790553] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] cli_script.dry_run = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.790731] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.790898] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.791059] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.791202] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.791338] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.791472] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.791604] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.791739] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.791902] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.792062] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.792197] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.792336] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.792477] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.792614] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.792748] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.792891] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.793037] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.793174] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.793314] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.793448] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.793580] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.793707] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.793837] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.794036] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.794196] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.794331] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.794464] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.794595] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.794726] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.794856] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.794990] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.ssl = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.795146] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.795284] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.795414] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.795595] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.795879] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.ssl_version = {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.796098] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.796320] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_notifications.driver = [] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.796527] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_notifications.retry = -1 {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.796695] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.796832] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] oslo_messaging_notifications.transport_url = **** {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 626.796942] env[65899]: DEBUG oslo_service.backend._eventlet.service [None req-9b7390b7-c5fd-4c20-bd67-c4368368efdc None None] ******************************************************************************** {{(pid=65899) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 626.798058] env[65899]: DEBUG neutron.agent.securitygroups_rpc [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Init firewall settings (driver=nsxv3) {{(pid=65899) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 626.799426] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65899) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 626.799663] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] RPC agent_id: nsxm-l-01a.corp.local [ 626.801924] env[65899]: DEBUG dogpile.cache.region [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.802120] env[65899]: DEBUG dogpile.lock [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.802275] env[65899]: DEBUG dogpile.lock [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.802418] env[65899]: DEBUG dogpile.lock [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.802572] env[65899]: DEBUG dogpile.cache.region [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.802724] env[65899]: DEBUG dogpile.lock [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.802919] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.823700] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Session token - acquiring [ 626.825235] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.825455] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.825527] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.825946] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.836270] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.122214] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 627.144490] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.144648] env[65899]: DEBUG dogpile.cache.region [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Cache value generated in 0.342 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.144811] env[65899]: DEBUG dogpile.lock [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.144874] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Activating Policy API Provider. [ 627.145041] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Looking for the default Infrastructure Rules. [ 627.216602] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Looking for the Default Layer3 Logged Drop Section. [ 627.237790] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 627.238264] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.238431] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.238534] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.238859] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.239202] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.756029] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.259440] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.763050] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Inventory metadata is going to be refreshed. [ 628.763050] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 629.583018] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.583018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.583018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.583018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.593219] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 629.594388] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.595446] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 629.613867] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.614316] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.614549] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.614934] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.615190] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.615430] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 629.615655] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 629.615850] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 629.637944] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.638450] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.638670] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.639067] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.639374] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.639637] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 629.663037] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.663037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.663037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.663037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.663037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.663037] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 629.690021] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.690021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.690021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.690021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.690021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.690021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 629.690021] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 629.690021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 629.706754] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.707375] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.707631] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.708025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.708287] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.708543] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 629.708779] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 629.710028] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 629.729029] env[65899]: DEBUG networking_nsxv3.common.locking [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.729510] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.729746] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.730158] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.732017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.732017] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 629.732017] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 629.732017] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Inventory metadata have been refreshed. [ 629.732017] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Dryrun:True. Metadata refresh completed. [ 629.732017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Releasing lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.733071] env[65899]: INFO neutron.agent.agent_extensions_manager [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Loaded agent extensions: [] [ 629.736214] env[65899]: DEBUG neutron_lib.callbacks.manager [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65899) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 629.798202] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent RPC Daemon Started! [ 629.799203] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent loop - iteration:0 started [ 629.799203] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent out of sync with plugin! [ 634.734544] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 634.734935] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 639.736472] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 639.736472] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 644.452038] env[65899]: INFO networking_nsxv3.common.synchronization [None req-998b7d0d-03fa-47b1-91d7-8d8c93c4052e demo admin] Enqueued Resource ID: 0bb9ee5d-849b-4f5d-be48-1694a3f240e4 with Priority: HIGHEST for action security_group_rules [ 644.452301] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bb9ee5d-849b-4f5d-be48-1694a3f240e4 with Priority: HIGHEST for action security_group_rules [ 644.452717] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bb9ee5d-849b-4f5d-be48-1694a3f240e4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.452868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bb9ee5d-849b-4f5d-be48-1694a3f240e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.452945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bb9ee5d-849b-4f5d-be48-1694a3f240e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.453318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bb9ee5d-849b-4f5d-be48-1694a3f240e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.453414] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bb9ee5d-849b-4f5d-be48-1694a3f240e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.974504] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.974504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.974504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.974504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.974504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.974504] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bb9ee5d-849b-4f5d-be48-1694a3f240e4 already deleted. [ 644.974504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bb9ee5d-849b-4f5d-be48-1694a3f240e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.453719] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 649.453999] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 654.454769] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 654.454769] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 659.455204] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 659.455490] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 664.456944] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 664.456944] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 665.738342] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.738342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.738342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.738342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.738342] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.241516] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.743696] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.245827] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 667.246139] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 668.079129] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.079129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.079129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.079520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.095238] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 668.096101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.096951] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 668.117066] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.117066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.117066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.117066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.117066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.117291] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 668.117291] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 668.117291] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 668.141787] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.142126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.142126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.142779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.142779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.142779] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 668.164291] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.164580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.164580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.164767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.164767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.164866] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 668.185105] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.185382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.185382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.186155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.186155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.186155] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 668.186155] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 668.186155] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 668.210066] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.210066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.210066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.210066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.210066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.210066] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 668.210066] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 668.210066] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 668.232418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.232696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.232696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.232825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.232903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.233023] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 668.233095] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 668.233150] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 668.233218] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 668.233288] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 668.233396] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 668.233396] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 668.233670] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 668.233750] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 668.233822] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 668.253719] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.253866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.253996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.254139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.254237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.254408] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 668.275461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.275666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.275666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.275859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.275955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.295085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.460521] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 669.460870] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 670.086086] env[65899]: INFO networking_nsxv3.common.synchronization [None req-16c62ee5-3cbf-46c9-85d6-38da967abb28 None None] Enqueued Resource ID: 5d735ea4-0432-4f7a-821a-a0498fd76c99 with Priority: HIGHEST for action port [ 670.086339] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d735ea4-0432-4f7a-821a-a0498fd76c99 with Priority: HIGHEST for action port [ 670.086908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d735ea4-0432-4f7a-821a-a0498fd76c99 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.087045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d735ea4-0432-4f7a-821a-a0498fd76c99" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.087112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d735ea4-0432-4f7a-821a-a0498fd76c99" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.087346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d735ea4-0432-4f7a-821a-a0498fd76c99" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.087426] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d735ea4-0432-4f7a-821a-a0498fd76c99',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.594019] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d735ea4-0432-4f7a-821a-a0498fd76c99 [ 670.594019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.594019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.594019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.594019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.594019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.594019] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d735ea4-0432-4f7a-821a-a0498fd76c99 already deleted. [ 670.594019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d735ea4-0432-4f7a-821a-a0498fd76c99" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.886610] env[65899]: INFO networking_nsxv3.common.synchronization [None req-b289281d-f3ac-4420-a64e-8b8d32ea74f5 None None] Enqueued Resource ID: f4733106-2491-48f2-933d-3d693bc68fb9 with Priority: HIGHEST for action port [ 671.887717] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4733106-2491-48f2-933d-3d693bc68fb9 with Priority: HIGHEST for action port [ 671.887717] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4733106-2491-48f2-933d-3d693bc68fb9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.888188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4733106-2491-48f2-933d-3d693bc68fb9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.888188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4733106-2491-48f2-933d-3d693bc68fb9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.888323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4733106-2491-48f2-933d-3d693bc68fb9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.888323] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4733106-2491-48f2-933d-3d693bc68fb9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.390321] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4733106-2491-48f2-933d-3d693bc68fb9 [ 672.391271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.391271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.391271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.391271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.391271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.391530] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4733106-2491-48f2-933d-3d693bc68fb9 already deleted. [ 672.391530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4733106-2491-48f2-933d-3d693bc68fb9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.890049] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 676.890351] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 677.498424] env[65899]: INFO networking_nsxv3.common.synchronization [None req-62b62b6f-7222-4345-8b53-ff4110249eb8 None None] Enqueued Resource ID: 3ae20842-e0b0-4d3b-a445-8abf132020d5 with Priority: HIGHEST for action port [ 677.498424] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ae20842-e0b0-4d3b-a445-8abf132020d5 with Priority: HIGHEST for action port [ 677.498424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ae20842-e0b0-4d3b-a445-8abf132020d5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.498424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ae20842-e0b0-4d3b-a445-8abf132020d5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.498424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ae20842-e0b0-4d3b-a445-8abf132020d5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.499080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ae20842-e0b0-4d3b-a445-8abf132020d5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.499854] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ae20842-e0b0-4d3b-a445-8abf132020d5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.007332] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ae20842-e0b0-4d3b-a445-8abf132020d5 [ 678.007332] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.007332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.007332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.007734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.007734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.007734] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ae20842-e0b0-4d3b-a445-8abf132020d5 already deleted. [ 678.007734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ae20842-e0b0-4d3b-a445-8abf132020d5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.092051] env[65899]: INFO networking_nsxv3.common.synchronization [None req-6cb48663-2b32-4b5d-a825-e78fff1335c0 None None] Enqueued Resource ID: 29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625 with Priority: HIGHEST for action port [ 678.093751] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625 with Priority: HIGHEST for action port [ 678.096151] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.096151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.096151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.096151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.096151] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.597648] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625 [ 678.598946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.598946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.598946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.598946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.598946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.598946] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625 already deleted. [ 678.598946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29e0c8e1-6dca-4b5a-8c38-c7da9a4fd625" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.862071] env[65899]: INFO networking_nsxv3.common.synchronization [None req-2dbc44b5-ad28-4d69-a701-11f16b47c54e None None] Enqueued Resource ID: 8eb81a63-d8f2-499d-89c6-9e5fbaf0111c with Priority: HIGHEST for action port [ 678.862163] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb81a63-d8f2-499d-89c6-9e5fbaf0111c with Priority: HIGHEST for action port [ 678.862530] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eb81a63-d8f2-499d-89c6-9e5fbaf0111c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.862628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eb81a63-d8f2-499d-89c6-9e5fbaf0111c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.862628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eb81a63-d8f2-499d-89c6-9e5fbaf0111c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.864310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eb81a63-d8f2-499d-89c6-9e5fbaf0111c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.864310] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eb81a63-d8f2-499d-89c6-9e5fbaf0111c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.989526] env[65899]: INFO networking_nsxv3.common.synchronization [None req-58c81996-3158-4aea-bc11-ee2bc03f9565 None None] Enqueued Resource ID: e07c59dc-e199-4110-92ba-757502da8361 with Priority: HIGHEST for action port [ 678.991143] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e07c59dc-e199-4110-92ba-757502da8361 with Priority: HIGHEST for action port [ 678.991143] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e07c59dc-e199-4110-92ba-757502da8361 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.991143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e07c59dc-e199-4110-92ba-757502da8361" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.991143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e07c59dc-e199-4110-92ba-757502da8361" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.991143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e07c59dc-e199-4110-92ba-757502da8361" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.991143] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e07c59dc-e199-4110-92ba-757502da8361',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.365775] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8eb81a63-d8f2-499d-89c6-9e5fbaf0111c [ 679.366089] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.366152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.366225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.366415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.366510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.366575] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8eb81a63-d8f2-499d-89c6-9e5fbaf0111c already deleted. [ 679.366653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eb81a63-d8f2-499d-89c6-9e5fbaf0111c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.494237] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e07c59dc-e199-4110-92ba-757502da8361 [ 679.494822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.494992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.495614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.495890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.495998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.496115] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e07c59dc-e199-4110-92ba-757502da8361 already deleted. [ 679.496198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e07c59dc-e199-4110-92ba-757502da8361" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.942630] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0639c26a-a06d-4d94-9ee3-5f42530f4042 None None] Enqueued Resource ID: 98c82bf8-b95c-4126-9592-38fb96b8a55f with Priority: HIGHEST for action port [ 679.943308] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c82bf8-b95c-4126-9592-38fb96b8a55f with Priority: HIGHEST for action port [ 679.943697] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-98c82bf8-b95c-4126-9592-38fb96b8a55f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.943818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98c82bf8-b95c-4126-9592-38fb96b8a55f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.943978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98c82bf8-b95c-4126-9592-38fb96b8a55f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.944162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98c82bf8-b95c-4126-9592-38fb96b8a55f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.944855] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c82bf8-b95c-4126-9592-38fb96b8a55f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.448608] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98c82bf8-b95c-4126-9592-38fb96b8a55f [ 680.448957] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.449054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.449098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.449285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.449394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.449495] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98c82bf8-b95c-4126-9592-38fb96b8a55f already deleted. [ 680.449605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98c82bf8-b95c-4126-9592-38fb96b8a55f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.607332] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0a3f8e63-5ee8-4b1f-898c-d8abd4e56e13 None None] Enqueued Resource ID: 8dd43d9c-fc8d-40f1-812c-0680e05e3b24 with Priority: HIGHEST for action port [ 680.609155] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dd43d9c-fc8d-40f1-812c-0680e05e3b24 with Priority: HIGHEST for action port [ 680.609155] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dd43d9c-fc8d-40f1-812c-0680e05e3b24 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.609155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dd43d9c-fc8d-40f1-812c-0680e05e3b24" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.610739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dd43d9c-fc8d-40f1-812c-0680e05e3b24" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.610739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dd43d9c-fc8d-40f1-812c-0680e05e3b24" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.610739] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dd43d9c-fc8d-40f1-812c-0680e05e3b24',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.002211] env[65899]: INFO networking_nsxv3.common.synchronization [None req-05162ec6-ca77-446e-8bd0-b69583c94e5c None None] Enqueued Resource ID: 25a8b1ad-2dd0-46af-a1b8-1e7c27433aee with Priority: HIGHEST for action port [ 681.002469] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25a8b1ad-2dd0-46af-a1b8-1e7c27433aee with Priority: HIGHEST for action port [ 681.003036] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-25a8b1ad-2dd0-46af-a1b8-1e7c27433aee taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.003160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25a8b1ad-2dd0-46af-a1b8-1e7c27433aee" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.003225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25a8b1ad-2dd0-46af-a1b8-1e7c27433aee" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.003466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25a8b1ad-2dd0-46af-a1b8-1e7c27433aee" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.003549] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25a8b1ad-2dd0-46af-a1b8-1e7c27433aee',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.114400] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dd43d9c-fc8d-40f1-812c-0680e05e3b24 [ 681.114641] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.114776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.114845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.115073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.115161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.115264] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dd43d9c-fc8d-40f1-812c-0680e05e3b24 already deleted. [ 681.115362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dd43d9c-fc8d-40f1-812c-0680e05e3b24" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.435187] env[65899]: INFO networking_nsxv3.common.synchronization [None req-71ceb75e-a31c-4c83-8e57-4d92b8a1389b None None] Enqueued Resource ID: 7ce89288-0c03-471c-884e-7e3306f0e1f1 with Priority: HIGHEST for action port [ 681.436547] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ce89288-0c03-471c-884e-7e3306f0e1f1 with Priority: HIGHEST for action port [ 681.436547] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ce89288-0c03-471c-884e-7e3306f0e1f1 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.436547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ce89288-0c03-471c-884e-7e3306f0e1f1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.436547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ce89288-0c03-471c-884e-7e3306f0e1f1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.436879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ce89288-0c03-471c-884e-7e3306f0e1f1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.436912] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ce89288-0c03-471c-884e-7e3306f0e1f1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.505993] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25a8b1ad-2dd0-46af-a1b8-1e7c27433aee [ 681.506270] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.506397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.506436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.507033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.507033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.507033] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25a8b1ad-2dd0-46af-a1b8-1e7c27433aee already deleted. [ 681.507033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25a8b1ad-2dd0-46af-a1b8-1e7c27433aee" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.940389] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ce89288-0c03-471c-884e-7e3306f0e1f1 [ 681.940666] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.940965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.941886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.942150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.942239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.942344] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ce89288-0c03-471c-884e-7e3306f0e1f1 already deleted. [ 681.942421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ce89288-0c03-471c-884e-7e3306f0e1f1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.504974] env[65899]: INFO networking_nsxv3.common.synchronization [None req-fdaa993e-4709-416c-87a2-65d061fe8a79 None None] Enqueued Resource ID: a5eb47c6-1b14-4312-9b7a-b3b058c17e0c with Priority: HIGHEST for action port [ 682.504974] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eb47c6-1b14-4312-9b7a-b3b058c17e0c with Priority: HIGHEST for action port [ 682.505424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5eb47c6-1b14-4312-9b7a-b3b058c17e0c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.505760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5eb47c6-1b14-4312-9b7a-b3b058c17e0c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.505834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5eb47c6-1b14-4312-9b7a-b3b058c17e0c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.506301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5eb47c6-1b14-4312-9b7a-b3b058c17e0c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.506541] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5eb47c6-1b14-4312-9b7a-b3b058c17e0c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.008558] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5eb47c6-1b14-4312-9b7a-b3b058c17e0c [ 683.008763] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.008897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.008961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.009187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.009288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.009398] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5eb47c6-1b14-4312-9b7a-b3b058c17e0c already deleted. [ 683.009485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5eb47c6-1b14-4312-9b7a-b3b058c17e0c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.625642] env[65899]: INFO networking_nsxv3.common.synchronization [None req-4dcccc55-a5fe-44eb-bd0d-c6a45838b0bf None None] Enqueued Resource ID: 87095fd4-606f-464f-ab26-5536cd6264ea with Priority: HIGHEST for action port [ 683.626292] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87095fd4-606f-464f-ab26-5536cd6264ea with Priority: HIGHEST for action port [ 683.626647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-87095fd4-606f-464f-ab26-5536cd6264ea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.627840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87095fd4-606f-464f-ab26-5536cd6264ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.627840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87095fd4-606f-464f-ab26-5536cd6264ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.627840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87095fd4-606f-464f-ab26-5536cd6264ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.627840] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87095fd4-606f-464f-ab26-5536cd6264ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.896969] env[65899]: INFO networking_nsxv3.common.synchronization [None req-994318e7-4a90-4590-a64a-4590fac0ce71 None None] Enqueued Resource ID: e527136c-ece4-420f-9855-08bc6b7f0ed3 with Priority: HIGHEST for action port [ 683.898268] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e527136c-ece4-420f-9855-08bc6b7f0ed3 with Priority: HIGHEST for action port [ 683.899190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e527136c-ece4-420f-9855-08bc6b7f0ed3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.899315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e527136c-ece4-420f-9855-08bc6b7f0ed3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.899993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e527136c-ece4-420f-9855-08bc6b7f0ed3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.899993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e527136c-ece4-420f-9855-08bc6b7f0ed3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.899993] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e527136c-ece4-420f-9855-08bc6b7f0ed3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.133028] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ce6f020-a2ba-4571-a594-f57757e85c38 req-45c08a40-e6ce-4536-b4ea-e0e7f14552c1 tempest-DeleteServersAdminTestJSON-1955726497 tempest-DeleteServersAdminTestJSON-1955726497-project-member] Enqueued Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 684.134610] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87095fd4-606f-464f-ab26-5536cd6264ea [ 684.134869] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.134924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.134995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.136603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.137612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.137612] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87095fd4-606f-464f-ab26-5536cd6264ea already deleted. [ 684.137612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87095fd4-606f-464f-ab26-5536cd6264ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.137612] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 684.138057] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.138182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.138245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.138464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.138650] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.138717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.138766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.138894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.138970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.139074] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.402714] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e527136c-ece4-420f-9855-08bc6b7f0ed3 [ 684.402854] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.403077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.403152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.403380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.403472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.403570] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e527136c-ece4-420f-9855-08bc6b7f0ed3 already deleted. [ 684.403651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e527136c-ece4-420f-9855-08bc6b7f0ed3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.641448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.643495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.643495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.643495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.643495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.643495] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.643495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.643495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.643495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.643495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.643495] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 already deleted. [ 684.644093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.475876] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0511ca6e-bc8f-424e-95e0-e4d6c91acc2b None None] Enqueued Resource ID: a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66 with Priority: HIGHEST for action port [ 685.477991] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66 with Priority: HIGHEST for action port [ 685.478968] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.479146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.479263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.479698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.479698] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.580572] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.580772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.580902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.581247] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.581877] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.582174] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.582174] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.583558] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.583558] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.583558] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.583558] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.583558] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.583558] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.583558] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.583558] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.583558] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.603848] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.604035] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.604180] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.604345] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.604667] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-a76184d3-a86f-4df1-bf30-b124761d09f4 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.604837] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-a76184d3-a86f-4df1-bf30-b124761d09f4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.604951] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-a76184d3-a86f-4df1-bf30-b124761d09f4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.605393] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-a76184d3-a86f-4df1-bf30-b124761d09f4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.605564] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a76184d3-a86f-4df1-bf30-b124761d09f4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.981961] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66 [ 685.982393] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.982479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.982479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.982891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.982891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.982891] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66 already deleted. [ 685.983307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a103dfcd-cefd-4ae7-8f3c-a0dd531b7d66" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.109179] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.109179] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.109179] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.109429] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.109470] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.109716] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port a76184d3-a86f-4df1-bf30-b124761d09f4 not found, creating... [ 686.112867] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.112867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.112867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.112867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.112867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.112867] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.112867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.112867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.112867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.112867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.113389] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: a76184d3-a86f-4df1-bf30-b124761d09f4 is going to be created. [ 686.136691] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.137258] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.137258] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.137359] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.137622] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.137779] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-a76184d3-a86f-4df1-bf30-b124761d09f4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.269489] env[65899]: INFO networking_nsxv3.common.synchronization [None req-870f85a5-6451-474e-8c03-ff58c0014176 None None] Enqueued Resource ID: 89db17b6-a966-4022-abf3-b7e748efbbf9 with Priority: HIGHEST for action port [ 686.270131] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89db17b6-a966-4022-abf3-b7e748efbbf9 with Priority: HIGHEST for action port [ 686.270496] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-89db17b6-a966-4022-abf3-b7e748efbbf9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.270637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89db17b6-a966-4022-abf3-b7e748efbbf9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.270708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89db17b6-a966-4022-abf3-b7e748efbbf9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.270975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89db17b6-a966-4022-abf3-b7e748efbbf9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.271237] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89db17b6-a966-4022-abf3-b7e748efbbf9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.775543] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89db17b6-a966-4022-abf3-b7e748efbbf9 [ 686.775543] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.775543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.775543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.775543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.775543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.775543] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89db17b6-a966-4022-abf3-b7e748efbbf9 already deleted. [ 686.775543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89db17b6-a966-4022-abf3-b7e748efbbf9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.997963] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ce6f020-a2ba-4571-a594-f57757e85c38 req-a77f0908-d369-4726-b83f-19888771a165 service nova] Enqueued Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_rules [ 686.998590] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ce6f020-a2ba-4571-a594-f57757e85c38 req-a77f0908-d369-4726-b83f-19888771a165 service nova] Enqueued Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 686.998798] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ce6f020-a2ba-4571-a594-f57757e85c38 req-a77f0908-d369-4726-b83f-19888771a165 service nova] Enqueued Resource ID: a76184d3-a86f-4df1-bf30-b124761d09f4 with Priority: HIGHEST for action port [ 686.999682] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_rules [ 686.999827] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 686.999930] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76184d3-a86f-4df1-bf30-b124761d09f4 with Priority: HIGHEST for action port [ 687.000274] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.000409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.000545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.001190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.001299] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.002175] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.002644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.002729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.003013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.003172] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.003172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.003259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.003378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.003475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.003767] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.005929] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a76184d3-a86f-4df1-bf30-b124761d09f4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.005929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a76184d3-a86f-4df1-bf30-b124761d09f4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.006073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a76184d3-a86f-4df1-bf30-b124761d09f4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.006202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a76184d3-a86f-4df1-bf30-b124761d09f4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.006249] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a76184d3-a86f-4df1-bf30-b124761d09f4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.103563] env[65899]: INFO networking_nsxv3.common.synchronization [None req-de211573-af58-4f34-817d-68f91e8fd66e None None] Enqueued Resource ID: 8dac9999-5617-4425-a10f-e01317a2d77f with Priority: HIGHEST for action port [ 687.104147] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dac9999-5617-4425-a10f-e01317a2d77f with Priority: HIGHEST for action port [ 687.104529] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dac9999-5617-4425-a10f-e01317a2d77f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.104654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dac9999-5617-4425-a10f-e01317a2d77f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.104721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dac9999-5617-4425-a10f-e01317a2d77f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.104957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dac9999-5617-4425-a10f-e01317a2d77f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.105129] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dac9999-5617-4425-a10f-e01317a2d77f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.511864] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.511864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.517345] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.518931] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a76184d3-a86f-4df1-bf30-b124761d09f4 with status ACTIVE [ 687.518931] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.518931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.518931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.518931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.518931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.520245] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.520245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.520245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.520245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.520245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.520245] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.520245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.520245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.520245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.520245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.520245] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a76184d3-a86f-4df1-bf30-b124761d09f4 is going to be updated. [ 687.542257] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.542257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.542257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.542257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.542610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.542610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a76184d3-a86f-4df1-bf30-b124761d09f4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.607626] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8dac9999-5617-4425-a10f-e01317a2d77f [ 687.607877] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.608029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.608100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.608348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.608400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.608489] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8dac9999-5617-4425-a10f-e01317a2d77f already deleted. [ 687.608571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dac9999-5617-4425-a10f-e01317a2d77f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.949183] env[65899]: INFO networking_nsxv3.common.synchronization [None req-d9dcad13-f2a5-4580-8842-82019ab56e99 tempest-ServersTestFqdnHostnames-1427128960 tempest-ServersTestFqdnHostnames-1427128960-project-member] Enqueued Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_rules [ 687.954028] env[65899]: INFO networking_nsxv3.common.synchronization [None req-67b45cab-1dd1-47fc-a7e7-818b7476974c tempest-ServersTestManualDisk-1669787664 tempest-ServersTestManualDisk-1669787664-project-member] Enqueued Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_rules [ 687.954028] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_rules [ 687.954028] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_rules [ 687.954028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b46602ad-46c7-4516-bebe-9e57e30f5e16 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.954028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.954028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.954028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.954028] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.954849] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad04559-d224-486f-adbe-3d9a2df06d0a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.955044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.955096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.955273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.955349] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.022553] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.474819] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3360e525-5c3e-4165-a5a7-5047ccf89844 None None] Enqueued Resource ID: ea7328f5-e9c5-4e9b-8aad-716f78ff48d0 with Priority: HIGHEST for action port [ 688.475377] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea7328f5-e9c5-4e9b-8aad-716f78ff48d0 with Priority: HIGHEST for action port [ 688.475678] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea7328f5-e9c5-4e9b-8aad-716f78ff48d0 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.475793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea7328f5-e9c5-4e9b-8aad-716f78ff48d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.477317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea7328f5-e9c5-4e9b-8aad-716f78ff48d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.477317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea7328f5-e9c5-4e9b-8aad-716f78ff48d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.477317] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea7328f5-e9c5-4e9b-8aad-716f78ff48d0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.478892] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.479114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.479682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.479682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.479682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.479682] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 already deleted. [ 688.479853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.482677] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.483309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.483309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.483309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.483309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.483309] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad04559-d224-486f-adbe-3d9a2df06d0a already deleted. [ 688.483503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.526715] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.527562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.527562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.527562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.527562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.527562] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 is going to be created. [ 688.554509] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.555220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.555346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.555787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.555958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.567246] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: UNINITIALIZED for 2s [ 688.963672] env[65899]: INFO networking_nsxv3.common.synchronization [None req-81a10378-76de-43bf-8003-0eb0901daba2 tempest-ServersTestFqdnHostnames-1427128960 tempest-ServersTestFqdnHostnames-1427128960-project-member] Enqueued Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_rules [ 688.964493] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_rules [ 688.964894] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b46602ad-46c7-4516-bebe-9e57e30f5e16 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.965072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.965174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.965847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.966015] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.979201] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea7328f5-e9c5-4e9b-8aad-716f78ff48d0 [ 688.979425] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.979512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.979618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.979769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.979864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.979950] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea7328f5-e9c5-4e9b-8aad-716f78ff48d0 already deleted. [ 688.980048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea7328f5-e9c5-4e9b-8aad-716f78ff48d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.984812] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0a09b2c2-9d41-4243-bd3e-be4c9af87db0 None None] Enqueued Resource ID: 1545d669-2527-4b41-99fd-e8fd9e168fb1 with Priority: HIGHEST for action port [ 688.985891] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1545d669-2527-4b41-99fd-e8fd9e168fb1 with Priority: HIGHEST for action port [ 688.986262] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1545d669-2527-4b41-99fd-e8fd9e168fb1 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.986418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1545d669-2527-4b41-99fd-e8fd9e168fb1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.986501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1545d669-2527-4b41-99fd-e8fd9e168fb1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.986793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1545d669-2527-4b41-99fd-e8fd9e168fb1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.987812] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1545d669-2527-4b41-99fd-e8fd9e168fb1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.057672] env[65899]: INFO networking_nsxv3.common.synchronization [None req-21c63f91-0fd9-4111-ba99-f10130fdd9ed tempest-ServersTestManualDisk-1669787664 tempest-ServersTestManualDisk-1669787664-project-member] Enqueued Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_rules [ 689.057960] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_rules [ 689.058307] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad04559-d224-486f-adbe-3d9a2df06d0a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.058462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.058534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.058736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.058815] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.490406] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1545d669-2527-4b41-99fd-e8fd9e168fb1 [ 689.490644] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.490793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.490862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.491137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.491260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.491491] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1545d669-2527-4b41-99fd-e8fd9e168fb1 already deleted. [ 689.491491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1545d669-2527-4b41-99fd-e8fd9e168fb1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.492495] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.492628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.492695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.492869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.492948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.493041] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 already deleted. [ 689.493118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.579908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.580126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.580126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.580331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.580408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.580480] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad04559-d224-486f-adbe-3d9a2df06d0a already deleted. [ 689.580552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.659263] env[65899]: INFO networking_nsxv3.common.synchronization [None req-366ac594-5bb5-43b7-a0d8-a40ece547925 None None] Enqueued Resource ID: fc003df5-5535-46c8-97c0-104cea109d7a with Priority: HIGHEST for action port [ 689.659263] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc003df5-5535-46c8-97c0-104cea109d7a with Priority: HIGHEST for action port [ 689.659263] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc003df5-5535-46c8-97c0-104cea109d7a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.659263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc003df5-5535-46c8-97c0-104cea109d7a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.659263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc003df5-5535-46c8-97c0-104cea109d7a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.659263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc003df5-5535-46c8-97c0-104cea109d7a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.659263] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc003df5-5535-46c8-97c0-104cea109d7a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.131286] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c81fda8d-bf40-450b-b74b-b18cd2699b88 None None] Enqueued Resource ID: fb2c822b-032d-491e-8b05-d6f3e22eb379 with Priority: HIGHEST for action port [ 690.131567] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2c822b-032d-491e-8b05-d6f3e22eb379 with Priority: HIGHEST for action port [ 690.132274] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb2c822b-032d-491e-8b05-d6f3e22eb379 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.132399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb2c822b-032d-491e-8b05-d6f3e22eb379" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.132466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb2c822b-032d-491e-8b05-d6f3e22eb379" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.132717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb2c822b-032d-491e-8b05-d6f3e22eb379" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.132799] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb2c822b-032d-491e-8b05-d6f3e22eb379',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.162411] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc003df5-5535-46c8-97c0-104cea109d7a [ 690.162683] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.162811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.162882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.163108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.163196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.163500] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc003df5-5535-46c8-97c0-104cea109d7a already deleted. [ 690.163500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc003df5-5535-46c8-97c0-104cea109d7a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.578830] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: SUCCESS [ 690.579083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.579248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.579460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.579650] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.579762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.579918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.580393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.580393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.580393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.580393] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.635812] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb2c822b-032d-491e-8b05-d6f3e22eb379 [ 690.635812] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.635812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.635812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.636182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.636182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.636182] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb2c822b-032d-491e-8b05-d6f3e22eb379 already deleted. [ 690.636182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb2c822b-032d-491e-8b05-d6f3e22eb379" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.084368] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.084518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.084585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.084794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.084975] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.085084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.085122] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.085252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.085329] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.085422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.085593] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.085693] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.085732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.085874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.089039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.089039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.089039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.089039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.089039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.089039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.089039] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.405081] env[65899]: INFO networking_nsxv3.common.synchronization [req-20696192-00e7-440f-a4ae-c86d0e4ad568 req-8e459ccf-7716-4cc8-a0af-1185d2b711ea tempest-ServersAdminNegativeTestJSON-1703860526 tempest-ServersAdminNegativeTestJSON-1703860526-project-member] Enqueued Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 691.405592] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 691.405905] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.406035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.406120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.406404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.406539] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.406637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.406691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.406843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.406923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.407019] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.591795] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6efcb92-8e15-4172-8949-8449dfa15fb3: rpc.has_security_group_logging(os_id): False [ 691.615216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.615216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.615216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.615216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.615853] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.617615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.617615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.617615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.617615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.617615] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 is going to be created. [ 691.686757] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.686757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.686757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.687059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.687059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.702421] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: IN_PROGRESS for 2s [ 691.908977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.909149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.913019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.913019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.913019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.913019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.913019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.913019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.913019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.913019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.913019] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a already deleted. [ 691.913019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.974938] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c2eb0687-5a9e-46c0-b208-7d1c8001cf3b None None] Enqueued Resource ID: e0c49c2a-651c-4e57-ba48-750012854ba5 with Priority: HIGHEST for action port [ 691.975101] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c49c2a-651c-4e57-ba48-750012854ba5 with Priority: HIGHEST for action port [ 691.975976] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0c49c2a-651c-4e57-ba48-750012854ba5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.976530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0c49c2a-651c-4e57-ba48-750012854ba5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.976530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0c49c2a-651c-4e57-ba48-750012854ba5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.976530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0c49c2a-651c-4e57-ba48-750012854ba5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.976668] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c49c2a-651c-4e57-ba48-750012854ba5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.418985] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.419315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.419380] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.419663] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.419928] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.420100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.420268] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.420540] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.420702] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.420964] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.421167] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.421329] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.421507] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.421670] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.421806] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.421957] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.443878] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.444098] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.444202] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.444336] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.444646] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-31533da9-e3c7-490d-8c28-23f9d6ca4f64 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.444813] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-31533da9-e3c7-490d-8c28-23f9d6ca4f64" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.444925] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-31533da9-e3c7-490d-8c28-23f9d6ca4f64" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.445282] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-31533da9-e3c7-490d-8c28-23f9d6ca4f64" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.445426] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31533da9-e3c7-490d-8c28-23f9d6ca4f64',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.479032] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0c49c2a-651c-4e57-ba48-750012854ba5 [ 692.479702] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.479702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.479702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.480072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.480072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.480072] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0c49c2a-651c-4e57-ba48-750012854ba5 already deleted. [ 692.480072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0c49c2a-651c-4e57-ba48-750012854ba5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.492354] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3488a43c-b59d-4ecd-83e9-0cc20df55b19 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_rules [ 692.493483] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_rules [ 692.493676] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78fc9585-54a3-4e16-8c58-5b307977bb8e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.494087] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.494179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.494511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.494511] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.702967] env[65899]: INFO networking_nsxv3.common.synchronization [None req-ab4b6300-d3a3-4fc8-8503-aeac1c57647c None None] Enqueued Resource ID: ef578497-01d0-46a2-aef9-8bd85fe4094e with Priority: HIGHEST for action port [ 692.703512] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef578497-01d0-46a2-aef9-8bd85fe4094e with Priority: HIGHEST for action port [ 692.703818] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef578497-01d0-46a2-aef9-8bd85fe4094e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.703932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef578497-01d0-46a2-aef9-8bd85fe4094e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.703988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef578497-01d0-46a2-aef9-8bd85fe4094e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.704445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef578497-01d0-46a2-aef9-8bd85fe4094e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.704445] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef578497-01d0-46a2-aef9-8bd85fe4094e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.742149] env[65899]: INFO networking_nsxv3.common.synchronization [None req-786672be-41fd-4f18-9d77-f4ed0435f962 None None] Enqueued Resource ID: cc98692e-4d37-4bab-9bec-9b45519d229c with Priority: HIGHEST for action port [ 692.743959] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc98692e-4d37-4bab-9bec-9b45519d229c with Priority: HIGHEST for action port [ 692.743959] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc98692e-4d37-4bab-9bec-9b45519d229c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.743959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc98692e-4d37-4bab-9bec-9b45519d229c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.743959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc98692e-4d37-4bab-9bec-9b45519d229c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.743959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc98692e-4d37-4bab-9bec-9b45519d229c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.743959] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc98692e-4d37-4bab-9bec-9b45519d229c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.951112] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.951112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.951112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.951112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.951112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.951112] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 31533da9-e3c7-490d-8c28-23f9d6ca4f64 not found, creating... [ 692.951112] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.951112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.951112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.951112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.951112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.951619] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.951619] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.951619] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.951619] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.951619] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.951619] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 31533da9-e3c7-490d-8c28-23f9d6ca4f64 is going to be created. [ 692.975311] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.975311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.975311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.975311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.975311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.975727] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-31533da9-e3c7-490d-8c28-23f9d6ca4f64" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.977922] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9673cade-2820-4eb5-a664-0045ac6786ee tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 692.979160] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 692.979991] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.980130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.980479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.980651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.981085] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.015945] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.015945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.015945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.015945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.015945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.015945] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e already deleted. [ 693.015945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.168779] env[65899]: INFO networking_nsxv3.common.synchronization [None req-2c54e208-3678-4fad-9fae-d084a01d104a tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_rules [ 693.170371] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_rules [ 693.170371] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78fc9585-54a3-4e16-8c58-5b307977bb8e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.170511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.171747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.171965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.172028] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.207026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef578497-01d0-46a2-aef9-8bd85fe4094e [ 693.207710] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.207710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.207710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207710] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef578497-01d0-46a2-aef9-8bd85fe4094e already deleted. [ 693.207936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef578497-01d0-46a2-aef9-8bd85fe4094e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.247776] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc98692e-4d37-4bab-9bec-9b45519d229c [ 693.248299] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.248408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.248446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.248713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.248829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.248957] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc98692e-4d37-4bab-9bec-9b45519d229c already deleted. [ 693.249078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc98692e-4d37-4bab-9bec-9b45519d229c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.314428] env[65899]: INFO networking_nsxv3.common.synchronization [None req-bf621c41-3021-4f0f-9046-06d315e38b95 tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 693.314901] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 693.315180] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.315311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.512487] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.512807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.512807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.512929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.512990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.513096] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 already deleted. [ 693.513321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.513321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.513503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.513552] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.693784] env[65899]: INFO networking_nsxv3.common.synchronization [req-20696192-00e7-440f-a4ae-c86d0e4ad568 req-f88ffd66-a93b-4786-a71e-f8a6b270e557 service nova] Enqueued Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_rules [ 693.693933] env[65899]: INFO networking_nsxv3.common.synchronization [req-20696192-00e7-440f-a4ae-c86d0e4ad568 req-f88ffd66-a93b-4786-a71e-f8a6b270e557 service nova] Enqueued Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 693.694079] env[65899]: INFO networking_nsxv3.common.synchronization [req-20696192-00e7-440f-a4ae-c86d0e4ad568 req-f88ffd66-a93b-4786-a71e-f8a6b270e557 service nova] Enqueued Resource ID: 31533da9-e3c7-490d-8c28-23f9d6ca4f64 with Priority: HIGHEST for action port [ 693.694302] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_rules [ 693.694432] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 693.694528] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31533da9-e3c7-490d-8c28-23f9d6ca4f64 with Priority: HIGHEST for action port [ 693.696211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.696363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.696434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.696688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.696867] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.698093] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.702193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.702193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.702193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.702386] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.702450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.705642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.705642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.705642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.705642] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.705642] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-31533da9-e3c7-490d-8c28-23f9d6ca4f64 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.705642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31533da9-e3c7-490d-8c28-23f9d6ca4f64" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.705642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31533da9-e3c7-490d-8c28-23f9d6ca4f64" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.705642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31533da9-e3c7-490d-8c28-23f9d6ca4f64" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.705642] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31533da9-e3c7-490d-8c28-23f9d6ca4f64',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.706100] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.706100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.706180] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.706261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.706338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.706421] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e already deleted. [ 693.706511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.722248] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: SUCCESS [ 693.722541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.034411] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.034542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.034542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.035105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.035105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.035105] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 already deleted. [ 694.035105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.210792] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.212377] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.212377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.212377] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31533da9-e3c7-490d-8c28-23f9d6ca4f64 with status ACTIVE [ 694.212685] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.212685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.212795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.213562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.213562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.213562] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.213562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.213562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.213562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.213842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.213842] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.213983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.214035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.214179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.214258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.214556] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31533da9-e3c7-490d-8c28-23f9d6ca4f64 is going to be updated. [ 694.256790] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.257088] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.257222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.257658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.257778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.258019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31533da9-e3c7-490d-8c28-23f9d6ca4f64" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.716466] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.221657] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.221847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.221924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.222175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.222266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.222364] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a is going to be created. [ 695.251129] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9ced3e9d-eaf7-4320-a107-e45ee8a26017 None None] Enqueued Resource ID: f9b707dc-7ad6-4893-81af-65284f4547c5 with Priority: HIGHEST for action port [ 695.254341] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.254341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.254341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.254579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.254692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.256721] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b707dc-7ad6-4893-81af-65284f4547c5 with Priority: HIGHEST for action port [ 695.257159] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9b707dc-7ad6-4893-81af-65284f4547c5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.257307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9b707dc-7ad6-4893-81af-65284f4547c5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.257377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9b707dc-7ad6-4893-81af-65284f4547c5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.257644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9b707dc-7ad6-4893-81af-65284f4547c5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.257761] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9b707dc-7ad6-4893-81af-65284f4547c5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.269801] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: UNINITIALIZED for 2s [ 695.334303] env[65899]: INFO networking_nsxv3.common.synchronization [req-c1669d25-9396-4624-bdb6-a432f30e3283 req-96d3ab0c-763b-4cf4-a4b1-01748ef48409 tempest-MigrationsAdminTest-1684116011 tempest-MigrationsAdminTest-1684116011-project-member] Enqueued Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 695.334891] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 695.335219] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.335344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.335433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.335661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.335810] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.335903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.335970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.336117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.336196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.336289] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.761250] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9b707dc-7ad6-4893-81af-65284f4547c5 [ 695.761753] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.761870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.762265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.762265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.762265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.762460] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9b707dc-7ad6-4893-81af-65284f4547c5 already deleted. [ 695.762460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9b707dc-7ad6-4893-81af-65284f4547c5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.768721] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.768721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.768721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.768977] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.769569] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.769569] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.769569] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.769771] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.769771] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.770875] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.771015] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.771135] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.771243] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.771354] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.771460] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.771623] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.791310] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.791947] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.791947] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.792116] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.792465] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-9ae46992-7ec9-43d4-a97a-e40ea7098f50 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.792712] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-9ae46992-7ec9-43d4-a97a-e40ea7098f50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.793165] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-9ae46992-7ec9-43d4-a97a-e40ea7098f50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.795150] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-9ae46992-7ec9-43d4-a97a-e40ea7098f50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.795322] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae46992-7ec9-43d4-a97a-e40ea7098f50',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.840417] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.840643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.840643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.840863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.840966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.841290] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.841290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.841467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.841467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.841773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.841773] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 already deleted. [ 695.841773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.119015] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c62e6642-25b9-4968-8a34-c426b5e270d8 None None] Enqueued Resource ID: 1f296d4f-f78c-4312-bdb6-e31b79845fb3 with Priority: HIGHEST for action port [ 696.119015] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f296d4f-f78c-4312-bdb6-e31b79845fb3 with Priority: HIGHEST for action port [ 696.119015] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f296d4f-f78c-4312-bdb6-e31b79845fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.119015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f296d4f-f78c-4312-bdb6-e31b79845fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.119015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f296d4f-f78c-4312-bdb6-e31b79845fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.119015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f296d4f-f78c-4312-bdb6-e31b79845fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.119015] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f296d4f-f78c-4312-bdb6-e31b79845fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.301656] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.301895] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.302025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.302302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.302444] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.302668] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 9ae46992-7ec9-43d4-a97a-e40ea7098f50 not found, creating... [ 696.302928] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.303092] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.303203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.303426] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.303562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.304407] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.304407] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.304407] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.304929] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.304929] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.304929] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 9ae46992-7ec9-43d4-a97a-e40ea7098f50 is going to be created. [ 696.327679] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.327890] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.328014] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.328366] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.328598] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.328725] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-9ae46992-7ec9-43d4-a97a-e40ea7098f50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.525302] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3de0b814-7bc5-490f-b953-39d6b2070b4a tempest-VolumesAssistedSnapshotsTest-2074954003 tempest-VolumesAssistedSnapshotsTest-2074954003-project-member] Enqueued Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_rules [ 696.525947] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_rules [ 696.527601] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-974c962f-0ed5-4445-b566-b0cc5bb30621 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.527601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.527601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.527601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.527601] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.619881] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f296d4f-f78c-4312-bdb6-e31b79845fb3 [ 696.619881] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.619881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.619881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.619881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.619881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.619881] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f296d4f-f78c-4312-bdb6-e31b79845fb3 already deleted. [ 696.619881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f296d4f-f78c-4312-bdb6-e31b79845fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.737436] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9c8c7b21-0a3c-4122-a663-08c55708f451 tempest-VolumesAssistedSnapshotsTest-2074954003 tempest-VolumesAssistedSnapshotsTest-2074954003-project-member] Enqueued Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_rules [ 696.738535] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_rules [ 696.738961] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-974c962f-0ed5-4445-b566-b0cc5bb30621 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.739115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.052252] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.054812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.054812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.054812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.054812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.054812] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 already deleted. [ 697.054812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.054812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.054812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.054812] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.121726] env[65899]: INFO networking_nsxv3.common.synchronization [req-c1669d25-9396-4624-bdb6-a432f30e3283 req-b24a4351-dc0f-441c-9a33-900b8db49e59 service nova] Enqueued Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_rules [ 697.121949] env[65899]: INFO networking_nsxv3.common.synchronization [req-c1669d25-9396-4624-bdb6-a432f30e3283 req-b24a4351-dc0f-441c-9a33-900b8db49e59 service nova] Enqueued Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 697.122100] env[65899]: INFO networking_nsxv3.common.synchronization [req-c1669d25-9396-4624-bdb6-a432f30e3283 req-b24a4351-dc0f-441c-9a33-900b8db49e59 service nova] Enqueued Resource ID: 9ae46992-7ec9-43d4-a97a-e40ea7098f50 with Priority: HIGHEST for action port [ 697.123796] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_rules [ 697.123796] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 697.123796] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae46992-7ec9-43d4-a97a-e40ea7098f50 with Priority: HIGHEST for action port [ 697.123796] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.124017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.124017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.124244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.124328] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.125621] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.125621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.125621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.125810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.127485] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.127485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.127485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.127485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.127485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.127485] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.127485] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ae46992-7ec9-43d4-a97a-e40ea7098f50 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.127485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ae46992-7ec9-43d4-a97a-e40ea7098f50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.127485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ae46992-7ec9-43d4-a97a-e40ea7098f50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.128167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ae46992-7ec9-43d4-a97a-e40ea7098f50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.128167] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae46992-7ec9-43d4-a97a-e40ea7098f50',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.281546] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: SUCCESS [ 697.281546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.281546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.281546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.281546] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.281546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.281546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.281546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.281546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.281546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.281546] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.522201] env[65899]: INFO networking_nsxv3.common.synchronization [req-bd4936ec-299a-4ab9-aa2f-885cb848049f req-386180be-8031-4b1b-a45b-310669fa1722 tempest-ImagesOneServerNegativeTestJSON-1508153592 tempest-ImagesOneServerNegativeTestJSON-1508153592-project-member] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 697.522201] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 697.522201] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.522201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.522201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.522201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.522201] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.522511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.522511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.522873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.522873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.522873] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.577481] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.577690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.577784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.578089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.578265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.578394] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 already deleted. [ 697.578505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.629285] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.629502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.629613] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ae46992-7ec9-43d4-a97a-e40ea7098f50 with status ACTIVE [ 697.629807] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.629898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.629942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.630167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.630242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.630426] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.630577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.630638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.630795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.630869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.631060] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.631152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.631200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.631344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.631410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.631542] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ae46992-7ec9-43d4-a97a-e40ea7098f50 is going to be updated. [ 697.632876] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.657149] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.657337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.657406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.657621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.657900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.658148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ae46992-7ec9-43d4-a97a-e40ea7098f50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.785300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.785455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.785528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.785743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.785910] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.786021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.786084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.786238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.786321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.786405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.786547] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.786638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.786893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.786893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.786995] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.787099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.787099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.787313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.787313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.787427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.787470] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.866038] env[65899]: INFO networking_nsxv3.common.synchronization [None req-d9016b4d-899e-4c91-904b-5921ba754f43 None None] Enqueued Resource ID: e6854193-bb7a-4007-97b5-55df2ca7e298 with Priority: HIGHEST for action port [ 697.866776] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6854193-bb7a-4007-97b5-55df2ca7e298 with Priority: HIGHEST for action port [ 697.867431] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6854193-bb7a-4007-97b5-55df2ca7e298 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.867431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6854193-bb7a-4007-97b5-55df2ca7e298" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.867431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6854193-bb7a-4007-97b5-55df2ca7e298" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.867876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6854193-bb7a-4007-97b5-55df2ca7e298" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.867876] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6854193-bb7a-4007-97b5-55df2ca7e298',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.939455] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.939696] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.939835] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.941285] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.943069] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.943331] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.943461] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.943763] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.943989] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.944570] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.944570] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.944570] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.944570] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.944776] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.944776] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.945019] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.970258] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.973024] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.973024] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.973024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.973024] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-e392b447-86e4-4964-81cd-de7c9168bd74 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.973024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-e392b447-86e4-4964-81cd-de7c9168bd74" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.973024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-e392b447-86e4-4964-81cd-de7c9168bd74" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.973024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-e392b447-86e4-4964-81cd-de7c9168bd74" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.973024] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e392b447-86e4-4964-81cd-de7c9168bd74',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.027010] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.028679] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.028679] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 already deleted. [ 698.028679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.135043] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.292270] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa6250d1-4a11-4b07-8308-040a7f86026a: rpc.has_security_group_logging(os_id): False [ 698.370673] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6854193-bb7a-4007-97b5-55df2ca7e298 [ 698.370673] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.370673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.370673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.370972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.371020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.371101] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6854193-bb7a-4007-97b5-55df2ca7e298 already deleted. [ 698.371284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6854193-bb7a-4007-97b5-55df2ca7e298" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.469575] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.469789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.469789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.470031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.470131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.470350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.470456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.470510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.470910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.470910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.470910] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.471143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.471143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.471219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.471334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.471893] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.472027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.472089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.472216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.472289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.472367] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a is going to be created. [ 698.477392] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.477592] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.478642] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.478945] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.479136] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.479308] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port e392b447-86e4-4964-81cd-de7c9168bd74 not found, creating... [ 698.479644] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.479815] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.479936] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.480185] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.480330] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.480906] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.481118] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.481238] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.481523] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.481918] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.482090] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: e392b447-86e4-4964-81cd-de7c9168bd74 is going to be created. [ 698.516276] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.516276] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.516276] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.516276] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.516276] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.516621] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-e392b447-86e4-4964-81cd-de7c9168bd74" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.572029] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.572240] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.572358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.574818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.574818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.590139] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: IN_PROGRESS for 2s [ 698.640301] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.640301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.640301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.640301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.640301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.640301] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 is going to be created. [ 698.699092] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.699589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.699589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.699743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.699941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.725954] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: UNINITIALIZED for 2s [ 699.336995] env[65899]: INFO networking_nsxv3.common.synchronization [req-bd4936ec-299a-4ab9-aa2f-885cb848049f req-243cd650-2758-4d63-8e38-aae2fc231956 service nova] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_rules [ 699.337273] env[65899]: INFO networking_nsxv3.common.synchronization [req-bd4936ec-299a-4ab9-aa2f-885cb848049f req-243cd650-2758-4d63-8e38-aae2fc231956 service nova] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 699.337308] env[65899]: INFO networking_nsxv3.common.synchronization [req-bd4936ec-299a-4ab9-aa2f-885cb848049f req-243cd650-2758-4d63-8e38-aae2fc231956 service nova] Enqueued Resource ID: e392b447-86e4-4964-81cd-de7c9168bd74 with Priority: HIGHEST for action port [ 699.337998] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_rules [ 699.338117] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 699.338250] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e392b447-86e4-4964-81cd-de7c9168bd74 with Priority: HIGHEST for action port [ 699.338629] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.338740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.338792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.339110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.339280] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.341247] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.341247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.341247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.341247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.341247] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.341247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.341247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.341648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.341648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.341648] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.342422] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e392b447-86e4-4964-81cd-de7c9168bd74 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.342541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e392b447-86e4-4964-81cd-de7c9168bd74" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.342679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e392b447-86e4-4964-81cd-de7c9168bd74" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.342798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e392b447-86e4-4964-81cd-de7c9168bd74" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.342844] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e392b447-86e4-4964-81cd-de7c9168bd74',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.844886] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.846088] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.846229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.846393] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e392b447-86e4-4964-81cd-de7c9168bd74 with status ACTIVE [ 699.846577] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.846706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.846795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.847025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.847109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.847322] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.847454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.847513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.847697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.847787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.847963] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.851855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.852021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.852190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.852282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.852736] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e392b447-86e4-4964-81cd-de7c9168bd74 is going to be updated. [ 699.876199] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.876199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.876199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.876344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.876808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.876808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e392b447-86e4-4964-81cd-de7c9168bd74" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.223457] env[65899]: INFO networking_nsxv3.common.synchronization [req-0ee901fe-9233-4036-bf71-480ba195bd52 req-af8d4f92-3879-4ef8-b3c2-9f5280d5c8d4 tempest-ServersTestFqdnHostnames-1427128960 tempest-ServersTestFqdnHostnames-1427128960-project-member] Enqueued Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_members [ 700.224190] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_members [ 700.224190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b46602ad-46c7-4516-bebe-9e57e30f5e16 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.226640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.226848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.227062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.227304] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.227376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.227422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.227613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.227707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.227804] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.356166] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.587687] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-99 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.588021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-99" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.588178] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-99" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.588562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-99" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.588885] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.589805] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.589987] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.590262] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.590428] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.590640] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.590754] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.590857] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.590961] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.591601] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.591601] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.591601] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.612229] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: SUCCESS [ 700.612456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.621568] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.621781] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.621984] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.622622] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-99" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.622778] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.623635] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.623635] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.623770] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.623917] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e01a11d9-d1d5-4c86-946e-4ecf5019e8d4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.731623] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.732050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.732339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.733301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.733565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.734352] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.734352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.734352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.737550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.737550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.737550] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 already deleted. [ 700.737550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.741255] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: SUCCESS [ 700.741255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.741255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.741255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.741255] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.741255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.741255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.741623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.742736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.742736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.742736] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.860952] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.861174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.861347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.861714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.861942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.863315] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be created. [ 700.899067] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.899359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.899359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.899612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.899756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.912763] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: UNINITIALIZED for 2s [ 701.127102] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.127337] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.127459] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.127809] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.127991] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.128163] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port e01a11d9-d1d5-4c86-946e-4ecf5019e8d4 not found, creating... [ 701.128432] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.128592] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.128696] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.128928] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.129158] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.129476] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.129662] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.129749] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.129968] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.130125] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.130254] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: e01a11d9-d1d5-4c86-946e-4ecf5019e8d4 is going to be created. [ 701.151810] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.152076] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.152206] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.152468] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.152724] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.152959] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.247937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.248145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.248230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.248440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.248619] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.248730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.248789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.248937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.249035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.249125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.249275] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.249370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.249425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.249595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.249746] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.249839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.249907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.250051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.250130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.250212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.250301] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.753072] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9813fef-8c97-4cb6-92ff-4d01107ef382: rpc.has_security_group_logging(os_id): False [ 701.787626] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.787720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.787912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.788037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.788090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.788289] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.788387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.788448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.788588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.788664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.788830] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.788940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.789014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.789158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.789231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.789411] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.789518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.789573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.789717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.789836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.789983] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 is going to be created. [ 701.878877] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.879109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.879109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.879331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.879609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.900145] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: IN_PROGRESS for 2s [ 701.924021] env[65899]: INFO networking_nsxv3.common.synchronization [req-0ee901fe-9233-4036-bf71-480ba195bd52 req-e9c93e27-6b26-40bc-8827-6d5c9b0026d1 service nova] Enqueued Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_rules [ 701.924206] env[65899]: INFO networking_nsxv3.common.synchronization [req-0ee901fe-9233-4036-bf71-480ba195bd52 req-e9c93e27-6b26-40bc-8827-6d5c9b0026d1 service nova] Enqueued Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_members [ 701.924400] env[65899]: INFO networking_nsxv3.common.synchronization [req-0ee901fe-9233-4036-bf71-480ba195bd52 req-e9c93e27-6b26-40bc-8827-6d5c9b0026d1 service nova] Enqueued Resource ID: e01a11d9-d1d5-4c86-946e-4ecf5019e8d4 with Priority: HIGHEST for action port [ 701.924922] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_rules [ 701.924973] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_members [ 701.925613] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01a11d9-d1d5-4c86-946e-4ecf5019e8d4 with Priority: HIGHEST for action port [ 701.925931] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b46602ad-46c7-4516-bebe-9e57e30f5e16 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.926071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.926139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.926469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.926469] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.927303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b46602ad-46c7-4516-bebe-9e57e30f5e16 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.927420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.927478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.927663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.927799] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.927925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.927973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.928142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.928262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.928354] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.930777] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.930777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.930777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.930777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.930777] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e01a11d9-d1d5-4c86-946e-4ecf5019e8d4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.436025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b46602ad-46c7-4516-bebe-9e57e30f5e16 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.436025] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.436025] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e01a11d9-d1d5-4c86-946e-4ecf5019e8d4 with status ACTIVE [ 702.436025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.436025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.436025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.436919] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.436919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.436919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.436919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.436919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.436919] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e01a11d9-d1d5-4c86-946e-4ecf5019e8d4 is going to be updated. [ 702.455529] env[65899]: INFO networking_nsxv3.common.synchronization [req-9b88979c-4dcc-4e10-8e2e-afc6cbe78da9 req-573c8fe5-aaff-41e4-8074-87dfa73a64fb tempest-ServersTestManualDisk-1669787664 tempest-ServersTestManualDisk-1669787664-project-member] Enqueued Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_members [ 702.456374] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_members [ 702.456455] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad04559-d224-486f-adbe-3d9a2df06d0a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.456632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.456721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.457034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.457617] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.457617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.457617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.457617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.457617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.457913] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.459651] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.459783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.459821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.459992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.460170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.460336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e01a11d9-d1d5-4c86-946e-4ecf5019e8d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.851585] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-371 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.852354] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-371" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.852354] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-371" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.852354] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-371" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.852608] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.852712] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.852832] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853115] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853267] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.853474] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.853585] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.853699] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.853793] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.853897] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 702.853996] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.854138] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.902292] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.902504] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 702.902589] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.902747] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-371" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.903140] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-99713dd8-0f8e-4222-8b9a-f65479db9016 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.903373] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-99713dd8-0f8e-4222-8b9a-f65479db9016" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.903523] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-99713dd8-0f8e-4222-8b9a-f65479db9016" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.903861] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-99713dd8-0f8e-4222-8b9a-f65479db9016" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.903993] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99713dd8-0f8e-4222-8b9a-f65479db9016',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.925103] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 702.925309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.925466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.926436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.926436] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.926436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.926436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.926436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.926436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.926436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.926757] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.939565] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.962511] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.962680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.962680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.962895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.962987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.963250] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.963356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.963356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.963484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.963590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.963628] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad04559-d224-486f-adbe-3d9a2df06d0a already deleted. [ 702.963700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.988505] env[65899]: INFO networking_nsxv3.common.synchronization [None req-66ea9f26-5d8a-41ad-8699-e387552959f8 None None] Enqueued Resource ID: 7e5da640-022d-48ea-8f0c-df8ffe8f9d6d with Priority: HIGHEST for action port [ 702.988996] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5da640-022d-48ea-8f0c-df8ffe8f9d6d with Priority: HIGHEST for action port [ 702.989348] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e5da640-022d-48ea-8f0c-df8ffe8f9d6d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.989469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e5da640-022d-48ea-8f0c-df8ffe8f9d6d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.989531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e5da640-022d-48ea-8f0c-df8ffe8f9d6d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.989778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e5da640-022d-48ea-8f0c-df8ffe8f9d6d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.989860] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e5da640-022d-48ea-8f0c-df8ffe8f9d6d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.406743] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.407011] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.407011] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.407323] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.407481] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.407657] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 99713dd8-0f8e-4222-8b9a-f65479db9016 not found, creating... [ 703.407972] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.408315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.408436] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.408666] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.408843] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.409744] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.409744] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.409744] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.409744] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.410055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.410055] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 99713dd8-0f8e-4222-8b9a-f65479db9016 is going to be created. [ 703.429009] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.429215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.429362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.429585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.429786] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.429908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.431884] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.431884] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.431884] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.435274] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.435274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.435274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.435516] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.435711] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.435919] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-99713dd8-0f8e-4222-8b9a-f65479db9016" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.441770] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.441906] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.441968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.442178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.442263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.442352] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 is going to be created. [ 703.480644] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.480876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.480876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.481090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.481248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.492299] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e5da640-022d-48ea-8f0c-df8ffe8f9d6d [ 703.492698] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.492899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.492985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.493384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.493522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.493645] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e5da640-022d-48ea-8f0c-df8ffe8f9d6d already deleted. [ 703.493751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e5da640-022d-48ea-8f0c-df8ffe8f9d6d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.500399] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 in Status: UNINITIALIZED for 2s [ 703.916983] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: SUCCESS [ 703.917300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.936415] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 698ff167-530f-4085-8a98-c574783d5ed9: rpc.has_security_group_logging(os_id): False [ 703.968096] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.968230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.968266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.968461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.968546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.968884] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.968983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.970995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.971393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.971510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.971829] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.972153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.972153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.972377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.973299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.973299] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.973299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.973299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.973299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.973299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.973299] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be created. [ 704.035881] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.036280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.036442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.036724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.037064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.050960] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 704.171116] env[65899]: INFO networking_nsxv3.common.synchronization [req-9b88979c-4dcc-4e10-8e2e-afc6cbe78da9 req-1d7b7ec5-c266-44ad-91f9-9cee10d5e854 service nova] Enqueued Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_rules [ 704.172020] env[65899]: INFO networking_nsxv3.common.synchronization [req-9b88979c-4dcc-4e10-8e2e-afc6cbe78da9 req-1d7b7ec5-c266-44ad-91f9-9cee10d5e854 service nova] Enqueued Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_members [ 704.172097] env[65899]: INFO networking_nsxv3.common.synchronization [req-9b88979c-4dcc-4e10-8e2e-afc6cbe78da9 req-1d7b7ec5-c266-44ad-91f9-9cee10d5e854 service nova] Enqueued Resource ID: 99713dd8-0f8e-4222-8b9a-f65479db9016 with Priority: HIGHEST for action port [ 704.172724] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_rules [ 704.172854] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_members [ 704.173076] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99713dd8-0f8e-4222-8b9a-f65479db9016 with Priority: HIGHEST for action port [ 704.173380] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dad04559-d224-486f-adbe-3d9a2df06d0a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.173504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.173565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.173782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.173860] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.175247] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad04559-d224-486f-adbe-3d9a2df06d0a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.175369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.175641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.175641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.175755] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.175841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.175903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.176419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.176527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.176668] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.177613] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-99713dd8-0f8e-4222-8b9a-f65479db9016 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.177613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99713dd8-0f8e-4222-8b9a-f65479db9016" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.177755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99713dd8-0f8e-4222-8b9a-f65479db9016" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.177849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99713dd8-0f8e-4222-8b9a-f65479db9016" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.177913] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99713dd8-0f8e-4222-8b9a-f65479db9016',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.681065] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad04559-d224-486f-adbe-3d9a2df06d0a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.681065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.681065] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.681416] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99713dd8-0f8e-4222-8b9a-f65479db9016 with status ACTIVE [ 704.681523] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.681818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.681818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.683192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.683192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.683192] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.683192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.683192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.683192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.683192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.683192] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.683192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.683922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.684582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.684582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.684582] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99713dd8-0f8e-4222-8b9a-f65479db9016 is going to be updated. [ 704.713718] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.713718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.713718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.713718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.713718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.713718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99713dd8-0f8e-4222-8b9a-f65479db9016" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.849263] env[65899]: INFO networking_nsxv3.common.synchronization [req-b7d92a44-cb6e-4769-b8dc-c02c193d9063 req-a2090edf-a72b-4ce1-a5c1-a6f5b8aeb3a5 tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 704.849491] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 704.849832] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.849967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.850323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.850639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.850803] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.850929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.850996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.851220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.851340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.851460] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.187842] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.211192] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.212032] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.212032] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.212032] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.212342] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.212480] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.212621] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.212888] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.213040] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.213368] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.213479] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.213609] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.213682] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.213785] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 705.213886] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.214041] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.234209] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.234393] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 705.234507] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.234679] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.234999] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.235184] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.235299] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.235625] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.235756] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a9a2d88-05d8-44bf-8dd1-7920a9d2086a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.258845] env[65899]: INFO networking_nsxv3.common.synchronization [None req-1bd93674-5b3a-4850-9590-6175f280c332 None None] Enqueued Resource ID: 5dc64913-1589-4735-91fd-bc3dbf2b9145 with Priority: HIGHEST for action port [ 705.262445] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc64913-1589-4735-91fd-bc3dbf2b9145 with Priority: HIGHEST for action port [ 705.262445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dc64913-1589-4735-91fd-bc3dbf2b9145 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.262445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dc64913-1589-4735-91fd-bc3dbf2b9145" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.262445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dc64913-1589-4735-91fd-bc3dbf2b9145" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.262445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dc64913-1589-4735-91fd-bc3dbf2b9145" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.262445] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dc64913-1589-4735-91fd-bc3dbf2b9145',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.354220] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.354425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.354425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.355810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.355810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.355810] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.355810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.355810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.355810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.355810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.355810] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 already deleted. [ 705.355810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.511591] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 in Status: SUCCESS [ 705.511999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.512331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.512694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.513000] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.513286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.513451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.513725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.513935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.514157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.515018] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.691616] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.691768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.691839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.692158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.692390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.692390] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad04559-d224-486f-adbe-3d9a2df06d0a is going to be created. [ 705.717901] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.718069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.718235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.718503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.718686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.728924] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad04559-d224-486f-adbe-3d9a2df06d0a in Status: UNINITIALIZED for 2s [ 705.741116] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.741351] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.741456] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.741843] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.741988] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.742152] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 7a9a2d88-05d8-44bf-8dd1-7920a9d2086a not found, creating... [ 705.742523] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.742670] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.742670] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.742934] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.743060] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.743310] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.743449] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.743554] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.743842] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.743900] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.744038] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 7a9a2d88-05d8-44bf-8dd1-7920a9d2086a is going to be created. [ 705.767833] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5dc64913-1589-4735-91fd-bc3dbf2b9145 [ 705.768082] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.768220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.768316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.769114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.769114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.769114] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5dc64913-1589-4735-91fd-bc3dbf2b9145 already deleted. [ 705.769114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dc64913-1589-4735-91fd-bc3dbf2b9145" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.780591] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.780591] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.780820] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.781433] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.781834] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.782096] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.016738] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.064602] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 706.064988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.482212] env[65899]: INFO networking_nsxv3.common.synchronization [req-b7d92a44-cb6e-4769-b8dc-c02c193d9063 req-a40f4c7d-0415-4aeb-b854-af2ca28afbbb service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 706.482600] env[65899]: INFO networking_nsxv3.common.synchronization [req-b7d92a44-cb6e-4769-b8dc-c02c193d9063 req-a40f4c7d-0415-4aeb-b854-af2ca28afbbb service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 706.482600] env[65899]: INFO networking_nsxv3.common.synchronization [req-b7d92a44-cb6e-4769-b8dc-c02c193d9063 req-a40f4c7d-0415-4aeb-b854-af2ca28afbbb service nova] Enqueued Resource ID: 7a9a2d88-05d8-44bf-8dd1-7920a9d2086a with Priority: HIGHEST for action port [ 706.483166] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 706.483250] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 706.483341] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9a2d88-05d8-44bf-8dd1-7920a9d2086a with Priority: HIGHEST for action port [ 706.483617] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.483741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.483806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.487288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.487288] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.487288] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.487288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.487677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.487677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.487677] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.487847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.487847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.488683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.488683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.488683] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.489275] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.489810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.491129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.491331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.491406] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a9a2d88-05d8-44bf-8dd1-7920a9d2086a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.519696] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b46602ad-46c7-4516-bebe-9e57e30f5e16: rpc.has_security_group_logging(os_id): False [ 706.539544] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.539728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.539814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.540098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.540239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.540483] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.540612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.540682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.540866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.540963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.541112] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 is going to be created. [ 706.611568] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.611814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.611965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.612132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.612339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.625821] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 in Status: IN_PROGRESS for 2s [ 706.994040] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.994818] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.994818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.994975] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a9a2d88-05d8-44bf-8dd1-7920a9d2086a with status ACTIVE [ 706.995158] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.995400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.995400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.995516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.999039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.999039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.999039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.999039] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a9a2d88-05d8-44bf-8dd1-7920a9d2086a is going to be updated. [ 707.023082] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.023610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.023978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.024063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.024233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.024409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a9a2d88-05d8-44bf-8dd1-7920a9d2086a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.086855] env[65899]: INFO networking_nsxv3.common.synchronization [req-f39829c1-7aad-492d-b653-1f9574f42e5e req-357b43fb-0941-425e-8346-664ce75576c5 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_members [ 707.087407] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_members [ 707.087958] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc9585-54a3-4e16-8c58-5b307977bb8e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.088099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.088166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.088475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.088750] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.088868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.088956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.089111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.089194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.089286] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.437668] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.437953] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.438097] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.438476] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.438884] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.439072] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.440112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.440112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.440112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.440112] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.440112] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.440112] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.440345] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.440345] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.440534] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.440534] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.462492] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.462492] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.462492] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.462492] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.463640] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.464616] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.464616] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.464958] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.465260] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.495591] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.593070] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.593343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.593343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.593502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.593599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.593894] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.594063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.594063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.594187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.594247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.594335] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e already deleted. [ 707.594415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.741118] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad04559-d224-486f-adbe-3d9a2df06d0a in Status: SUCCESS [ 707.741346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.741531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.742199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.742199] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.742199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.742418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.742499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.742551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.742674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.742808] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.970489] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.970585] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.971167] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.971167] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.971167] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.971315] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b not found, creating... [ 707.971514] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.971730] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.971888] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.971888] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.971888] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.972663] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.972663] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.973016] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.973073] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.973259] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.973341] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b is going to be created. [ 707.999753] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.000077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.000224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.000626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.000726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.000897] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be created. [ 708.003768] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.004064] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.004197] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.004462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.004683] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.004978] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.037028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.037206] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.037274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.037537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.037696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.051359] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: UNINITIALIZED for 2s [ 708.247014] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.647444] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 in Status: SUCCESS [ 708.647444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.748928] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dad04559-d224-486f-adbe-3d9a2df06d0a: rpc.has_security_group_logging(os_id): False [ 708.771310] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.771544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.771544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.771882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.771978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.772332] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.772571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.772667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.772921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.773047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.773148] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dad04559-d224-486f-adbe-3d9a2df06d0a is going to be created. [ 708.844637] env[65899]: INFO networking_nsxv3.common.synchronization [req-f39829c1-7aad-492d-b653-1f9574f42e5e req-c4f69427-20e6-4824-987d-2c72471d2e33 service nova] Enqueued Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_rules [ 708.844926] env[65899]: INFO networking_nsxv3.common.synchronization [req-f39829c1-7aad-492d-b653-1f9574f42e5e req-c4f69427-20e6-4824-987d-2c72471d2e33 service nova] Enqueued Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_members [ 708.845093] env[65899]: INFO networking_nsxv3.common.synchronization [req-f39829c1-7aad-492d-b653-1f9574f42e5e req-c4f69427-20e6-4824-987d-2c72471d2e33 service nova] Enqueued Resource ID: d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b with Priority: HIGHEST for action port [ 708.846232] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_rules [ 708.846368] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_members [ 708.846466] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b with Priority: HIGHEST for action port [ 708.846825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78fc9585-54a3-4e16-8c58-5b307977bb8e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.846942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.847278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.847530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.847622] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.848902] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc9585-54a3-4e16-8c58-5b307977bb8e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.849045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.849109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.849319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.849505] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.849568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.849606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.849731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.849846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.850155] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.854413] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.854413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.854413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.854413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.854413] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.922248] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.922483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.922483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.922667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.922854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.948439] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dad04559-d224-486f-adbe-3d9a2df06d0a in Status: IN_PROGRESS for 2s [ 709.354424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc9585-54a3-4e16-8c58-5b307977bb8e taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.354588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.354813] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.356198] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b with status ACTIVE [ 709.356198] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.356198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.356367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.356438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.356511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.356694] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.356812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.356889] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.358068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.358068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.358068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.358068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.358068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.358068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.358068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.358068] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b is going to be updated. [ 709.387098] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.387345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.387456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.388093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.388331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.388580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d28cdfff-bc47-4fe1-b8d0-77f7ffdc4c0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.859818] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.041515] env[65899]: INFO networking_nsxv3.common.synchronization [req-3c29d151-6885-4333-aeab-aa30c1b2fc97 req-8de0d6e4-8154-43fa-b909-28b7a40c7589 tempest-DeleteServersAdminTestJSON-1918643239 tempest-DeleteServersAdminTestJSON-1918643239-project-admin] Enqueued Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 710.042152] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 710.042516] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.042695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.042767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.044056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.044357] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.044477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.044542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.044743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.044843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.044921] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.065868] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 710.065868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.065868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.066118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.066687] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.066687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.066687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.066687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.066687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.066687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.066986] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.363423] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.363423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.363423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.363727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.363727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.363727] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e is going to be created. [ 710.406434] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.406638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.406710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.406928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.407154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.425120] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e in Status: UNINITIALIZED for 2s [ 710.546906] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.547078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.547149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.547373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.547468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.547667] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.547768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.547828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.547978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.548614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.548614] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 is going to be updated. [ 710.571809] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.571978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.572068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.572300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.572525] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.572653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.572723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.572895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.573219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.573353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.573514] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.573605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.573664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.575533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.575743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.575867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.575966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.576218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.576874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.577182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.577358] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.581476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.582576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.582576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.582576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.582576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.595593] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: IN_PROGRESS for 2s [ 710.968537] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dad04559-d224-486f-adbe-3d9a2df06d0a in Status: SUCCESS [ 710.968835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.081316] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc14a464-84a2-4f30-88ae-7b0da98e4e95: rpc.has_security_group_logging(os_id): False [ 711.104423] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.104423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.104423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.104423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.104423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.104865] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.104865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.104865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.105042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.105042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.105164] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.105254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.105312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.106036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.106036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.106157] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.106221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.106266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.106407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.106484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.106573] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be created. [ 711.197352] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.197352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.197352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.197352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.197352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.213430] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 712.435697] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e in Status: SUCCESS [ 712.436057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.436151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.436679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.436679] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.436679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.436947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.436947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.437036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.437103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.437265] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.607078] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: SUCCESS [ 712.607260] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 deletion is rescheduled due to dependency. [ 712.607379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.942699] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.230436] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 713.231034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.449018] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78fc9585-54a3-4e16-8c58-5b307977bb8e: rpc.has_security_group_logging(os_id): False [ 713.469912] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.470152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.470218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.470431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.470543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.470817] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.470918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.470983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.471179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.471277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.471374] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e is going to be created. [ 713.534108] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.534280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.534349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.534561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.534741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.546869] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e in Status: IN_PROGRESS for 2s [ 714.020067] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0b0d9334-16a6-4dd4-9d93-ee3b75882eb0 None None] Enqueued Resource ID: 5542c875-2af9-4341-aea6-7d954f26cfa2 with Priority: HIGHEST for action port [ 714.020067] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5542c875-2af9-4341-aea6-7d954f26cfa2 with Priority: HIGHEST for action port [ 714.020067] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5542c875-2af9-4341-aea6-7d954f26cfa2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.020067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5542c875-2af9-4341-aea6-7d954f26cfa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.020067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5542c875-2af9-4341-aea6-7d954f26cfa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.020067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5542c875-2af9-4341-aea6-7d954f26cfa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.020067] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5542c875-2af9-4341-aea6-7d954f26cfa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.466901] env[65899]: INFO networking_nsxv3.common.synchronization [req-ddf35efb-80bb-44a5-8d21-f857c69a845b req-43175641-ab74-4cca-b60b-b56385c7df5a tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 714.466901] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 714.467375] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.467478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.467549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.468093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.468093] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.468322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.468322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.468429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.468484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.468580] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.522419] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5542c875-2af9-4341-aea6-7d954f26cfa2 [ 714.523423] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.523423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.523423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.523685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.525068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.525068] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5542c875-2af9-4341-aea6-7d954f26cfa2 already deleted. [ 714.525068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5542c875-2af9-4341-aea6-7d954f26cfa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.844941] env[65899]: INFO networking_nsxv3.common.synchronization [None req-47f821ae-69b9-47d4-ac41-e52ad5c97955 None None] Enqueued Resource ID: f08184f4-adbe-4c73-af77-2d187a2bb966 with Priority: HIGHEST for action port [ 714.845515] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f08184f4-adbe-4c73-af77-2d187a2bb966 with Priority: HIGHEST for action port [ 714.845748] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f08184f4-adbe-4c73-af77-2d187a2bb966 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.845868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f08184f4-adbe-4c73-af77-2d187a2bb966" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.845929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f08184f4-adbe-4c73-af77-2d187a2bb966" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.846356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f08184f4-adbe-4c73-af77-2d187a2bb966" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.846356] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f08184f4-adbe-4c73-af77-2d187a2bb966',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.902591] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.902963] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-455" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.903102] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-455" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.903502] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-455" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.904105] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.904105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.904105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.904272] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.904466] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.904667] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.904793] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.904922] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.905668] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.905668] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.905668] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.905668] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.928536] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.928536] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.928536] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.928536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-455" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.928536] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-653c31a0-7d12-45e4-99a5-2ae0b332606c taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.928536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.928536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.928536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.928536] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('653c31a0-7d12-45e4-99a5-2ae0b332606c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.971284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.971284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.971284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.971615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.971615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.971911] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.972031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.972031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.972182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.974737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.974737] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 already deleted. [ 714.974737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.348910] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f08184f4-adbe-4c73-af77-2d187a2bb966 [ 715.349287] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.349390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.349432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.349744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.349848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.349945] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f08184f4-adbe-4c73-af77-2d187a2bb966 already deleted. [ 715.350040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f08184f4-adbe-4c73-af77-2d187a2bb966" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.432369] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.433505] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.433933] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.433933] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.434127] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.434259] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 653c31a0-7d12-45e4-99a5-2ae0b332606c not found, creating... [ 715.434531] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.434694] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.434807] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.435148] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.438363] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.438363] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.438363] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.438363] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.438363] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.438363] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.438363] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c is going to be created. [ 715.459872] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.460266] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.460441] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.460852] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.460929] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.461169] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.590532] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e in Status: SUCCESS [ 715.592238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.197393] env[65899]: INFO networking_nsxv3.common.synchronization [req-ddf35efb-80bb-44a5-8d21-f857c69a845b req-7f99f4f7-2723-4215-8a5e-fc946f3b347b service nova] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 716.197393] env[65899]: INFO networking_nsxv3.common.synchronization [req-ddf35efb-80bb-44a5-8d21-f857c69a845b req-7f99f4f7-2723-4215-8a5e-fc946f3b347b service nova] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 716.197516] env[65899]: INFO networking_nsxv3.common.synchronization [req-ddf35efb-80bb-44a5-8d21-f857c69a845b req-7f99f4f7-2723-4215-8a5e-fc946f3b347b service nova] Enqueued Resource ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c with Priority: HIGHEST for action port [ 716.200944] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 716.200944] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 716.200944] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c with Priority: HIGHEST for action port [ 716.200944] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.200944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.200944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.200944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.200944] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.203052] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.203052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.203052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.204367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.204367] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.204367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.204367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.204367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.204367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.204367] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.205601] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-653c31a0-7d12-45e4-99a5-2ae0b332606c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.205767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.205767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.205950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.206349] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('653c31a0-7d12-45e4-99a5-2ae0b332606c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.709414] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.709861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.709978] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.711995] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 653c31a0-7d12-45e4-99a5-2ae0b332606c with status ACTIVE [ 716.711995] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.711995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.711995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.711995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.715045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.715045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.715045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.715045] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c is going to be updated. [ 716.746615] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.746951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.747065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.747938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.747938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.747938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.857980] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0c0d1246-533d-4c74-bbfc-c10f81156a13 None None] Enqueued Resource ID: 5ed40522-7814-423d-83b0-62e1428045d3 with Priority: HIGHEST for action port [ 716.859148] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ed40522-7814-423d-83b0-62e1428045d3 with Priority: HIGHEST for action port [ 716.859582] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ed40522-7814-423d-83b0-62e1428045d3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.859785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ed40522-7814-423d-83b0-62e1428045d3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.859920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ed40522-7814-423d-83b0-62e1428045d3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.860436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ed40522-7814-423d-83b0-62e1428045d3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.860436] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ed40522-7814-423d-83b0-62e1428045d3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.219031] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.364919] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ed40522-7814-423d-83b0-62e1428045d3 [ 717.364919] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.364919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.364919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.364919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.365467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.365467] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ed40522-7814-423d-83b0-62e1428045d3 already deleted. [ 717.365581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ed40522-7814-423d-83b0-62e1428045d3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.721544] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.721935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.721935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.722261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.722261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.722327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be created. [ 717.733474] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9d361657-5a60-433b-a116-b6a486a1119e None None] Enqueued Resource ID: e82d73a2-3585-45a8-8cef-e2c45eb71ae5 with Priority: HIGHEST for action port [ 717.734177] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e82d73a2-3585-45a8-8cef-e2c45eb71ae5 with Priority: HIGHEST for action port [ 717.735271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e82d73a2-3585-45a8-8cef-e2c45eb71ae5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.735271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e82d73a2-3585-45a8-8cef-e2c45eb71ae5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.735271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e82d73a2-3585-45a8-8cef-e2c45eb71ae5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.735271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e82d73a2-3585-45a8-8cef-e2c45eb71ae5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.735271] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e82d73a2-3585-45a8-8cef-e2c45eb71ae5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.753862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.754108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.754108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.754298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.754451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.767421] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: UNINITIALIZED for 2s [ 718.240385] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e82d73a2-3585-45a8-8cef-e2c45eb71ae5 [ 718.240385] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.240385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.240385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.240385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.240385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.240385] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e82d73a2-3585-45a8-8cef-e2c45eb71ae5 already deleted. [ 718.240385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e82d73a2-3585-45a8-8cef-e2c45eb71ae5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.429990] env[65899]: INFO networking_nsxv3.common.synchronization [req-23c8cb60-4937-463c-a971-87bc33b1f26a req-558a246f-9ccc-4a6f-be99-eb9a811e685c tempest-VolumesAssistedSnapshotsTest-2074954003 tempest-VolumesAssistedSnapshotsTest-2074954003-project-member] Enqueued Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_members [ 718.430644] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_members [ 718.430644] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-974c962f-0ed5-4445-b566-b0cc5bb30621 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.430644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.430644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.431196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.431757] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.431907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.431977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.432173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.432261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.432356] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.568534] env[65899]: INFO networking_nsxv3.common.synchronization [None req-5488ec9e-14b3-496c-90ac-02bd74bf5a6b tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_rules [ 718.569132] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_rules [ 718.569436] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.569552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.569628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.571086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.571086] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.656176] env[65899]: INFO networking_nsxv3.common.synchronization [None req-089efc23-c6de-46db-9a3c-a447d8de5304 tempest-ServersWithSpecificFlavorTestJSON-353865173 tempest-ServersWithSpecificFlavorTestJSON-353865173-project-member] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_rules [ 718.656176] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_rules [ 718.656176] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.656176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.656176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.656626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.656626] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.857812] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.857812] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-800" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.857812] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-800" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.858822] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-800" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.858822] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.858822] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.858822] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.859066] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.859225] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.859444] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.859508] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.859888] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.859888] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.859888] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.860124] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.860124] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.875787] env[65899]: INFO networking_nsxv3.common.synchronization [None req-2c6793e4-b83f-4c47-96e7-652de90999b6 tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_rules [ 718.876753] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_rules [ 718.877304] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.877771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.894327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.894501] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.894642] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.894826] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-800" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.895166] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.895713] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.895713] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.896124] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.896124] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5df1402d-1ebc-4c1b-bf28-b27bf10e7d56',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.936954] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.936954] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.936954] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 already deleted. [ 718.936954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.033702] env[65899]: INFO networking_nsxv3.common.synchronization [None req-26de96bd-182c-4518-8cbb-84cafecb225b tempest-ServersWithSpecificFlavorTestJSON-353865173 tempest-ServersWithSpecificFlavorTestJSON-353865173-project-member] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_rules [ 719.034285] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_rules [ 719.034634] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.034742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.092501] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.092728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.092728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.093116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.093116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.093250] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c already deleted. [ 719.093250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.093377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.093537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.093624] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.178475] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.178682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.178682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.178901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.179069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.179182] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 already deleted. [ 719.179333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.179569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.179830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.179966] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.385331] env[65899]: INFO networking_nsxv3.common.synchronization [None req-aeda3e07-9cb6-41d3-b163-a8294a2432dd None None] Enqueued Resource ID: ed9a0412-0b41-4588-ab86-820ad0c5ba1f with Priority: HIGHEST for action port [ 719.385866] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed9a0412-0b41-4588-ab86-820ad0c5ba1f with Priority: HIGHEST for action port [ 719.386222] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed9a0412-0b41-4588-ab86-820ad0c5ba1f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.386818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed9a0412-0b41-4588-ab86-820ad0c5ba1f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.386891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed9a0412-0b41-4588-ab86-820ad0c5ba1f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.387181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed9a0412-0b41-4588-ab86-820ad0c5ba1f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.387334] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed9a0412-0b41-4588-ab86-820ad0c5ba1f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.398173] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.398504] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.398504] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.398749] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.398882] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.399063] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 5df1402d-1ebc-4c1b-bf28-b27bf10e7d56 not found, creating... [ 719.399333] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.399476] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.399607] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.399936] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.400078] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.400352] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.400495] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.400600] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.400799] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.400916] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.401052] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 5df1402d-1ebc-4c1b-bf28-b27bf10e7d56 is going to be created. [ 719.423664] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.423877] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.424029] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.424323] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.424623] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.424783] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.620249] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.620249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.620249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.620512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.620543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.620687] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c already deleted. [ 719.621987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.707751] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.707751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.707751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.707751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.707751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.707751] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 already deleted. [ 719.707751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.779534] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 719.779534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.779534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.779534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.779859] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.779988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.780073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.780251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.780326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.780472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.780546] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.889390] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed9a0412-0b41-4588-ab86-820ad0c5ba1f [ 719.889736] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.889803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.890238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.890238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.890238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.890359] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed9a0412-0b41-4588-ab86-820ad0c5ba1f already deleted. [ 719.890408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed9a0412-0b41-4588-ab86-820ad0c5ba1f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.184658] env[65899]: INFO networking_nsxv3.common.synchronization [req-23c8cb60-4937-463c-a971-87bc33b1f26a req-21fa845a-c698-412f-9f71-e512f0f3cdc5 service nova] Enqueued Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_rules [ 720.184854] env[65899]: INFO networking_nsxv3.common.synchronization [req-23c8cb60-4937-463c-a971-87bc33b1f26a req-21fa845a-c698-412f-9f71-e512f0f3cdc5 service nova] Enqueued Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_members [ 720.185037] env[65899]: INFO networking_nsxv3.common.synchronization [req-23c8cb60-4937-463c-a971-87bc33b1f26a req-21fa845a-c698-412f-9f71-e512f0f3cdc5 service nova] Enqueued Resource ID: 5df1402d-1ebc-4c1b-bf28-b27bf10e7d56 with Priority: HIGHEST for action port [ 720.186398] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_rules [ 720.186398] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_members [ 720.186624] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5df1402d-1ebc-4c1b-bf28-b27bf10e7d56 with Priority: HIGHEST for action port [ 720.186972] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-974c962f-0ed5-4445-b566-b0cc5bb30621 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.187627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.187627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.187627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.187627] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.191436] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-974c962f-0ed5-4445-b566-b0cc5bb30621 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.191571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.191642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.191936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.192137] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.192254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.192318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.192499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.192587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.192684] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.194573] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.194695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.194759] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.194962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.195084] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5df1402d-1ebc-4c1b-bf28-b27bf10e7d56',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.283609] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.698995] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-974c962f-0ed5-4445-b566-b0cc5bb30621 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.698995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.701263] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.702898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5df1402d-1ebc-4c1b-bf28-b27bf10e7d56 with status ACTIVE [ 720.703151] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.703324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.703406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.703658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.703779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.703988] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.707292] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.707394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.707628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.707748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.708030] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.708162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.708269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.708408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.708495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.711882] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5df1402d-1ebc-4c1b-bf28-b27bf10e7d56 is going to be updated. [ 720.736614] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.737500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.737500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.737500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.737500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.737776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5df1402d-1ebc-4c1b-bf28-b27bf10e7d56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.787133] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdbdafb6-4c78-4b83-b960-c24d6a937e53: rpc.has_security_group_logging(os_id): False [ 720.814753] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.814928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.815063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.816200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.816200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.816200] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.816200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.816576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.816576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.816669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.816819] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be created. [ 720.917099] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.917099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.917554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.917554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.917648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.931358] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: IN_PROGRESS for 2s [ 721.206954] env[65899]: INFO networking_nsxv3.common.synchronization [req-8fbd4ea4-8ca6-4135-a45d-5fb98ae4c3c3 req-87a0e41d-9ad8-4651-85bb-160555023e99 tempest-FloatingIPsAssociationNegativeTestJSON-1197764129 tempest-FloatingIPsAssociationNegativeTestJSON-1197764129-project-member] Enqueued Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGHEST for action security_group_members [ 721.208069] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGHEST for action security_group_members [ 721.208069] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6607a38e-6205-4531-b5e6-7fd1d3e900ea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.208069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.209081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.209081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.209081] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.209282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.209282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.209417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.209507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.209605] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.211070] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.713927] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.714266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.714391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.714740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.714891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.715252] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.715624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.715624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.715748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.716119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.716119] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea already deleted. [ 721.716119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.716350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.716451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.716517] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.716718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.716788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.716830] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 is going to be created. [ 721.746470] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.746627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.746675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.746901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.747049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.758839] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 in Status: UNINITIALIZED for 2s [ 721.789685] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-39 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.789836] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.789956] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.790307] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.790567] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.790741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.790902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.791413] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.791678] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.792027] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.792104] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.792160] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.792306] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.792359] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.792798] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.792798] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.831826] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.832032] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.832162] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.832342] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.832672] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-546f5659-ced0-41a2-87e7-1fa229c4899d taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.832877] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-546f5659-ced0-41a2-87e7-1fa229c4899d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.832961] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-546f5659-ced0-41a2-87e7-1fa229c4899d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.833306] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-546f5659-ced0-41a2-87e7-1fa229c4899d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.833434] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('546f5659-ced0-41a2-87e7-1fa229c4899d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.306560] env[65899]: INFO networking_nsxv3.common.synchronization [None req-7989b2af-c694-4037-a50c-64eb7ed7b285 None None] Enqueued Resource ID: 6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f with Priority: HIGHEST for action port [ 722.307144] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f with Priority: HIGHEST for action port [ 722.307603] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.307819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.308203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.308336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.308456] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.338332] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.338332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.338332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.338332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.338332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.338332] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 546f5659-ced0-41a2-87e7-1fa229c4899d not found, creating... [ 722.338332] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.338332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.338332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.338332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.338332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.338929] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.339120] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.339285] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.339510] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.339703] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.340162] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 546f5659-ced0-41a2-87e7-1fa229c4899d is going to be created. [ 722.364028] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.364281] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.364281] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.366125] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.366125] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.366125] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-546f5659-ced0-41a2-87e7-1fa229c4899d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.811187] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f [ 722.812023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.812023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.812249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.812358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.812404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.813031] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f already deleted. [ 722.813031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ca2baaa-2dd0-4c9b-9a53-6c82d49b8f9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.945168] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 722.945381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.099465] env[65899]: INFO networking_nsxv3.common.synchronization [req-8fbd4ea4-8ca6-4135-a45d-5fb98ae4c3c3 req-59b74177-1e87-41d2-b9f4-cf487510a224 service nova] Enqueued Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGHEST for action security_group_rules [ 723.099665] env[65899]: INFO networking_nsxv3.common.synchronization [req-8fbd4ea4-8ca6-4135-a45d-5fb98ae4c3c3 req-59b74177-1e87-41d2-b9f4-cf487510a224 service nova] Enqueued Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGHEST for action security_group_members [ 723.099827] env[65899]: INFO networking_nsxv3.common.synchronization [req-8fbd4ea4-8ca6-4135-a45d-5fb98ae4c3c3 req-59b74177-1e87-41d2-b9f4-cf487510a224 service nova] Enqueued Resource ID: 546f5659-ced0-41a2-87e7-1fa229c4899d with Priority: HIGHEST for action port [ 723.100439] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGHEST for action security_group_rules [ 723.100578] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGHEST for action security_group_members [ 723.105285] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546f5659-ced0-41a2-87e7-1fa229c4899d with Priority: HIGHEST for action port [ 723.105714] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.105844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.105927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.106225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.106344] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.110020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6607a38e-6205-4531-b5e6-7fd1d3e900ea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.110020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.110020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.110020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.110020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.110020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.110020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.110020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.110020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.110020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.110962] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-546f5659-ced0-41a2-87e7-1fa229c4899d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.111107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-546f5659-ced0-41a2-87e7-1fa229c4899d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.111563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-546f5659-ced0-41a2-87e7-1fa229c4899d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.111563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-546f5659-ced0-41a2-87e7-1fa229c4899d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.111563] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('546f5659-ced0-41a2-87e7-1fa229c4899d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.614548] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6607a38e-6205-4531-b5e6-7fd1d3e900ea taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.614548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.614548] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.618300] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 546f5659-ced0-41a2-87e7-1fa229c4899d with status ACTIVE [ 723.618300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.618300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.618300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.618300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.618300] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 546f5659-ced0-41a2-87e7-1fa229c4899d is going to be updated. [ 723.646533] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.647292] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.647292] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.647444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.647501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.648515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-546f5659-ced0-41a2-87e7-1fa229c4899d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.770932] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 in Status: SUCCESS [ 723.771442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.771442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.772100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.772100] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.772100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.772277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.772428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.772428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.772514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.772601] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.121131] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.280438] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.625750] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.625750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.625750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.625750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.625750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.625750] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea is going to be created. [ 724.653477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.653477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.653477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.653477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.653477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.667608] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea in Status: UNINITIALIZED for 2s [ 724.781185] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 974c962f-0ed5-4445-b566-b0cc5bb30621: rpc.has_security_group_logging(os_id): False [ 724.802488] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.802739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.802934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.803321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.803413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.803874] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.803972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.803972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.804271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.804347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.804428] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 is going to be created. [ 724.925105] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.925105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.925105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.925105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.925105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.937423] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 in Status: IN_PROGRESS for 2s [ 726.365991] env[65899]: INFO networking_nsxv3.common.synchronization [req-48fca6ed-faa2-4fc4-88d4-54db207a767c req-2f8000d2-5ddb-487e-b212-c009a8778766 tempest-SecurityGroupRulesTestJSON-609420685 tempest-SecurityGroupRulesTestJSON-609420685-project-member] Enqueued Resource ID: f66ed132-7c76-4c48-a122-b5dbc20e2f04 with Priority: HIGHEST for action security_group_rules [ 726.369016] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f66ed132-7c76-4c48-a122-b5dbc20e2f04 with Priority: HIGHEST for action security_group_rules [ 726.369016] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f66ed132-7c76-4c48-a122-b5dbc20e2f04 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.369016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f66ed132-7c76-4c48-a122-b5dbc20e2f04" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.369016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f66ed132-7c76-4c48-a122-b5dbc20e2f04" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.369016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f66ed132-7c76-4c48-a122-b5dbc20e2f04" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.369016] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f66ed132-7c76-4c48-a122-b5dbc20e2f04',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.684040] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea in Status: SUCCESS [ 726.684040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.684040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.684040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.684040] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.684040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.684040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.684040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.684040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.684040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.684040] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.894028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.894278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.894359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.894601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.894715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.894831] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f66ed132-7c76-4c48-a122-b5dbc20e2f04 already deleted. [ 726.894936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f66ed132-7c76-4c48-a122-b5dbc20e2f04" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.951036] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 in Status: SUCCESS [ 726.951214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.187251] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6607a38e-6205-4531-b5e6-7fd1d3e900ea taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.187445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.187554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.187840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.188020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.188127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.188183] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.188338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.188419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.188502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.188647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6607a38e-6205-4531-b5e6-7fd1d3e900ea taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.188736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.188793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.188937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.189167] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.189255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.189307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.189447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.189519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.189590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.189675] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.692574] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6607a38e-6205-4531-b5e6-7fd1d3e900ea: rpc.has_security_group_logging(os_id): False [ 727.716194] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.716430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.716567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.716904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.717061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.717366] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.717520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.717624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.717885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.718489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.718802] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.718963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.719188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.719322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.719510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.719770] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.719906] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.720035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.720273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.720388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.720542] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea is going to be created. [ 727.832546] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.832709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.832754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.833032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.833561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.848392] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea in Status: IN_PROGRESS for 2s [ 727.886149] env[65899]: INFO networking_nsxv3.common.synchronization [None req-5da13559-2d48-4acd-8162-9501f0addb81 None None] Enqueued Resource ID: 5e3d2b87-ec48-4dc7-98a7-f7ca89d53350 with Priority: HIGHEST for action port [ 727.886811] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3d2b87-ec48-4dc7-98a7-f7ca89d53350 with Priority: HIGHEST for action port [ 727.889364] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e3d2b87-ec48-4dc7-98a7-f7ca89d53350 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.889589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e3d2b87-ec48-4dc7-98a7-f7ca89d53350" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.889709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e3d2b87-ec48-4dc7-98a7-f7ca89d53350" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.890153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e3d2b87-ec48-4dc7-98a7-f7ca89d53350" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.890256] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e3d2b87-ec48-4dc7-98a7-f7ca89d53350',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.394069] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e3d2b87-ec48-4dc7-98a7-f7ca89d53350 [ 728.394069] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.394400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.394400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.394464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.394546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.394640] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e3d2b87-ec48-4dc7-98a7-f7ca89d53350 already deleted. [ 728.394722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e3d2b87-ec48-4dc7-98a7-f7ca89d53350" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.765393] env[65899]: INFO networking_nsxv3.common.synchronization [None req-b5f3caeb-4d9c-420a-873d-8b4b578b94c9 None None] Enqueued Resource ID: 9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0 with Priority: HIGHEST for action port [ 728.768311] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0 with Priority: HIGHEST for action port [ 728.768311] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.768311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.768311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.768311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.768311] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.240486] env[65899]: INFO networking_nsxv3.common.synchronization [req-5699acc0-47f4-48b8-b097-8646e95065e4 req-d1dad288-f841-460d-b105-70ee608afcab tempest-ServersAdminNegativeTestJSON-1703860526 tempest-ServersAdminNegativeTestJSON-1703860526-project-member] Enqueued Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 729.241053] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 729.241465] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.241549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.241614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.241937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.242130] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.242598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.242598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.242598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.242598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.242759] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.269415] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0 [ 729.269638] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.269828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.269943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.270149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.270838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.270838] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0 already deleted. [ 729.270838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b4bc4c0-4025-41b2-8947-7c0c6b7cb8d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.610264] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.611789] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.611789] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.611789] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.612193] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.612405] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.612755] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.612816] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.613024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.613376] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.613554] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.613733] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.614234] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.614234] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.614234] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.614382] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.633291] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.633418] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 729.633571] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.633741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.634114] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.634300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.634421] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.634758] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.636068] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84b0e8b6-21ab-4dd7-9d37-32476c1a509e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.744945] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.866123] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea in Status: SUCCESS [ 729.866469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.140688] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.140918] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.141038] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.141556] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.141556] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.141683] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 84b0e8b6-21ab-4dd7-9d37-32476c1a509e not found, creating... [ 730.141927] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.142105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.142216] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.142445] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.142562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.142860] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.143035] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.143128] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.143298] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.143947] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.143947] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 84b0e8b6-21ab-4dd7-9d37-32476c1a509e is going to be created. [ 730.172597] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.172829] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.173033] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.173321] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.173542] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.173763] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.251418] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.321251] env[65899]: INFO networking_nsxv3.common.synchronization [None req-bb6fc34d-d076-4ce8-9936-952f83bb1a17 None None] Enqueued Resource ID: 704ac74b-e37f-4f82-8032-a099e42bb01d with Priority: HIGHEST for action port [ 730.321251] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704ac74b-e37f-4f82-8032-a099e42bb01d with Priority: HIGHEST for action port [ 730.321251] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-704ac74b-e37f-4f82-8032-a099e42bb01d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.321797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-704ac74b-e37f-4f82-8032-a099e42bb01d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.322210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-704ac74b-e37f-4f82-8032-a099e42bb01d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.322921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-704ac74b-e37f-4f82-8032-a099e42bb01d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.323175] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704ac74b-e37f-4f82-8032-a099e42bb01d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.754858] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.754955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.755667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.755667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.755667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.755667] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a is going to be updated. [ 730.824267] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.824472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.824548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.824824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.825080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.828763] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 704ac74b-e37f-4f82-8032-a099e42bb01d [ 730.828996] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.829177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.829256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.829559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.829725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.829828] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:704ac74b-e37f-4f82-8032-a099e42bb01d already deleted. [ 730.829928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-704ac74b-e37f-4f82-8032-a099e42bb01d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.840682] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: IN_PROGRESS for 2s [ 730.978600] env[65899]: INFO networking_nsxv3.common.synchronization [req-5699acc0-47f4-48b8-b097-8646e95065e4 req-623b052c-4012-4cb0-a607-4346359ebcc9 service nova] Enqueued Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_rules [ 730.978877] env[65899]: INFO networking_nsxv3.common.synchronization [req-5699acc0-47f4-48b8-b097-8646e95065e4 req-623b052c-4012-4cb0-a607-4346359ebcc9 service nova] Enqueued Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 730.978877] env[65899]: INFO networking_nsxv3.common.synchronization [req-5699acc0-47f4-48b8-b097-8646e95065e4 req-623b052c-4012-4cb0-a607-4346359ebcc9 service nova] Enqueued Resource ID: 84b0e8b6-21ab-4dd7-9d37-32476c1a509e with Priority: HIGHEST for action port [ 730.979026] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_rules [ 730.979123] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 730.979219] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84b0e8b6-21ab-4dd7-9d37-32476c1a509e with Priority: HIGHEST for action port [ 730.979771] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.979899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.979963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.981261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.981822] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.982703] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.982799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.983224] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.983224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.983224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.983391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.983422] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84b0e8b6-21ab-4dd7-9d37-32476c1a509e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.485643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.486379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.486802] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84b0e8b6-21ab-4dd7-9d37-32476c1a509e with status ACTIVE [ 731.487233] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.487416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.487518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.487792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.487911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.488200] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.488357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.488450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.488680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.488796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.489017] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.489647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.489851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.490099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.490234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.490362] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84b0e8b6-21ab-4dd7-9d37-32476c1a509e is going to be updated. [ 731.525223] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.525223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.525466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.525512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.525668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.525841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84b0e8b6-21ab-4dd7-9d37-32476c1a509e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.844027] env[65899]: INFO networking_nsxv3.common.synchronization [req-19f72c80-18b0-472c-935b-ad6eb5f34159 req-57f06695-c15c-4006-86a3-d292deb7f6ae tempest-ServerRescueTestJSON-492744644 tempest-ServerRescueTestJSON-492744644-project-member] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 731.844699] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 731.845245] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.845386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.845447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.845765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.845956] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.846103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.846179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.846419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.846558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.846729] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.352020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.352020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.352020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.352020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.352601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.352601] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.352601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.352601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.353072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.353072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.353072] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea93861-5728-4289-9609-763ed4d27c02 already deleted. [ 732.353072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.852486] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: SUCCESS [ 732.852486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.852625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.852914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.852914] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.853136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.853136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.855166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.855166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.855166] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.921399] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.921672] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-875" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.922034] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-875" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.923165] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-875" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.923331] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.923809] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.924043] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.924505] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.924717] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.925245] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.925364] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.925469] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.925570] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.925693] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.925773] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.925898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.946168] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.946354] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.946476] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.946649] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-875" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.946959] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-2407f2c2-0958-45a9-8314-50542f746878 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.947155] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-2407f2c2-0958-45a9-8314-50542f746878" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.947338] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-2407f2c2-0958-45a9-8314-50542f746878" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.947730] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-2407f2c2-0958-45a9-8314-50542f746878" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.947897] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2407f2c2-0958-45a9-8314-50542f746878',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.046917] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3b74d29e-17fb-4373-bf25-0d4299463bc9 None None] Enqueued Resource ID: 40bf6590-1464-4b4c-91a0-93eb78051373 with Priority: HIGHEST for action port [ 733.047409] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40bf6590-1464-4b4c-91a0-93eb78051373 with Priority: HIGHEST for action port [ 733.047707] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-40bf6590-1464-4b4c-91a0-93eb78051373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.047830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40bf6590-1464-4b4c-91a0-93eb78051373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.047899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40bf6590-1464-4b4c-91a0-93eb78051373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.050792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40bf6590-1464-4b4c-91a0-93eb78051373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.052258] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40bf6590-1464-4b4c-91a0-93eb78051373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.122114] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3e4784d6-b586-442b-b37d-8b19cfbee336 None None] Enqueued Resource ID: 99fdd1d1-abac-4f42-a4ba-c4a5dccad640 with Priority: HIGHEST for action port [ 733.123469] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99fdd1d1-abac-4f42-a4ba-c4a5dccad640 with Priority: HIGHEST for action port [ 733.123841] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-99fdd1d1-abac-4f42-a4ba-c4a5dccad640 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.123971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99fdd1d1-abac-4f42-a4ba-c4a5dccad640" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.124054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99fdd1d1-abac-4f42-a4ba-c4a5dccad640" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.124701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99fdd1d1-abac-4f42-a4ba-c4a5dccad640" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.124832] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99fdd1d1-abac-4f42-a4ba-c4a5dccad640',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.356597] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.451265] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.451265] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.451265] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.451543] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.451543] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.452472] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 2407f2c2-0958-45a9-8314-50542f746878 not found, creating... [ 733.452472] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.452472] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.452472] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.452472] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.452791] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.452824] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.452997] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.453115] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.454144] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.454144] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.454144] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 2407f2c2-0958-45a9-8314-50542f746878 is going to be created. [ 733.474053] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.474281] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.474395] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.474664] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.474882] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.475126] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-2407f2c2-0958-45a9-8314-50542f746878" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.553989] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40bf6590-1464-4b4c-91a0-93eb78051373 [ 733.554269] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.554419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.554485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.554729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.554824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.555528] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40bf6590-1464-4b4c-91a0-93eb78051373 already deleted. [ 733.555784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40bf6590-1464-4b4c-91a0-93eb78051373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.629061] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99fdd1d1-abac-4f42-a4ba-c4a5dccad640 [ 733.629061] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.630032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.630032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.630032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.630032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.630032] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99fdd1d1-abac-4f42-a4ba-c4a5dccad640 already deleted. [ 733.630032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99fdd1d1-abac-4f42-a4ba-c4a5dccad640" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.859401] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.191907] env[65899]: INFO networking_nsxv3.common.synchronization [req-19f72c80-18b0-472c-935b-ad6eb5f34159 req-4e659123-bfc1-44b2-8e37-813c2648cbb7 service nova] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_rules [ 734.191997] env[65899]: INFO networking_nsxv3.common.synchronization [req-19f72c80-18b0-472c-935b-ad6eb5f34159 req-4e659123-bfc1-44b2-8e37-813c2648cbb7 service nova] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 734.192249] env[65899]: INFO networking_nsxv3.common.synchronization [req-19f72c80-18b0-472c-935b-ad6eb5f34159 req-4e659123-bfc1-44b2-8e37-813c2648cbb7 service nova] Enqueued Resource ID: 2407f2c2-0958-45a9-8314-50542f746878 with Priority: HIGHEST for action port [ 734.192587] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_rules [ 734.192587] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 734.193053] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2407f2c2-0958-45a9-8314-50542f746878 with Priority: HIGHEST for action port [ 734.194028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.194028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.194028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.194447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.194447] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.195212] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.195850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.195850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.195850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.195850] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.195850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.195850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.196117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.196117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.196188] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.199112] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-2407f2c2-0958-45a9-8314-50542f746878 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.199112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2407f2c2-0958-45a9-8314-50542f746878" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.199112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2407f2c2-0958-45a9-8314-50542f746878" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.200058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2407f2c2-0958-45a9-8314-50542f746878" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.200058] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2407f2c2-0958-45a9-8314-50542f746878',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.361136] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.361544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.361544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.361959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.361959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.361959] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a is going to be updated. [ 734.407102] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.407414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.407578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.407880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.408177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.427068] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: IN_PROGRESS for 2s [ 734.701168] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.701269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.701480] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.702615] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2407f2c2-0958-45a9-8314-50542f746878 with status ACTIVE [ 734.702615] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.702799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.702799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.703036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.703139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.703326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.703425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.703486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.703639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.703727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.703886] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.703977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.704048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.704189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.704261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.704343] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2407f2c2-0958-45a9-8314-50542f746878 is going to be updated. [ 734.729187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.729187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.729187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.729187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.729187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.729187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2407f2c2-0958-45a9-8314-50542f746878" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.896034] env[65899]: INFO networking_nsxv3.common.synchronization [req-e2e55539-ed57-48cc-811f-9a903292cb66 req-1981be1b-b069-46b2-a940-a344fcf89cdb tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 734.896730] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 734.897224] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.899125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.899125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.899125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.899125] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.899125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.899125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.899125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.899125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.899125] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.055019] env[65899]: INFO networking_nsxv3.common.synchronization [None req-62b661cf-ee12-4618-b2a9-4468d2ab31e9 None None] Enqueued Resource ID: 9fd68d68-98f2-4b9f-bef0-c17d1d11eba4 with Priority: HIGHEST for action port [ 735.055019] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fd68d68-98f2-4b9f-bef0-c17d1d11eba4 with Priority: HIGHEST for action port [ 735.055019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fd68d68-98f2-4b9f-bef0-c17d1d11eba4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.055019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fd68d68-98f2-4b9f-bef0-c17d1d11eba4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.055019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fd68d68-98f2-4b9f-bef0-c17d1d11eba4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.055019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fd68d68-98f2-4b9f-bef0-c17d1d11eba4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.055019] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fd68d68-98f2-4b9f-bef0-c17d1d11eba4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.207789] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.316325] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.317504] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.317504] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.326465] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.326912] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.327058] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.327105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.327334] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.327474] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.327683] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.327784] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.327889] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.328094] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.328094] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.328202] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.328324] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.351220] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.351534] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.351679] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.351851] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.352211] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-b654bc3a-4ad1-4684-8d04-9777d6265460 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.352846] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-b654bc3a-4ad1-4684-8d04-9777d6265460" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.353035] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-b654bc3a-4ad1-4684-8d04-9777d6265460" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.353659] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-b654bc3a-4ad1-4684-8d04-9777d6265460" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.353659] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b654bc3a-4ad1-4684-8d04-9777d6265460',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.402489] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.402762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.402762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.403054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.403116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.403580] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.403580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.403580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.403742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.403742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.403819] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c already deleted. [ 735.404102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.557542] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fd68d68-98f2-4b9f-bef0-c17d1d11eba4 [ 735.558778] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.558778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.558778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.558778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.558778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.558778] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fd68d68-98f2-4b9f-bef0-c17d1d11eba4 already deleted. [ 735.558778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fd68d68-98f2-4b9f-bef0-c17d1d11eba4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.710046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.710046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.710219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.710332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.710424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.710521] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea93861-5728-4289-9609-763ed4d27c02 is going to be created. [ 735.738487] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.738487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.738487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.738695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.739433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.756639] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: UNINITIALIZED for 2s [ 735.857589] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.857781] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.857829] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.858269] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.858269] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.858422] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port b654bc3a-4ad1-4684-8d04-9777d6265460 not found, creating... [ 735.859015] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.859015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.859015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.859268] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.859405] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.859992] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.860322] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.860521] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.861240] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.861240] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.861240] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: b654bc3a-4ad1-4684-8d04-9777d6265460 is going to be created. [ 735.914154] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.914399] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.914474] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.914730] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.914978] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.915200] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-b654bc3a-4ad1-4684-8d04-9777d6265460" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.446502] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: SUCCESS [ 736.446900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.446949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.447197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.447418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.447544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.447624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.447794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.447889] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.447978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.448110] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.654350] env[65899]: INFO networking_nsxv3.common.synchronization [req-e2e55539-ed57-48cc-811f-9a903292cb66 req-b40aa3a5-acf7-4eb7-889c-6a3b176cd81c service nova] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_rules [ 736.654350] env[65899]: INFO networking_nsxv3.common.synchronization [req-e2e55539-ed57-48cc-811f-9a903292cb66 req-b40aa3a5-acf7-4eb7-889c-6a3b176cd81c service nova] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 736.654350] env[65899]: INFO networking_nsxv3.common.synchronization [req-e2e55539-ed57-48cc-811f-9a903292cb66 req-b40aa3a5-acf7-4eb7-889c-6a3b176cd81c service nova] Enqueued Resource ID: b654bc3a-4ad1-4684-8d04-9777d6265460 with Priority: HIGHEST for action port [ 736.654872] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_rules [ 736.655028] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 736.655128] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654bc3a-4ad1-4684-8d04-9777d6265460 with Priority: HIGHEST for action port [ 736.655825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.656072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.656253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.656600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.656963] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.658743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.658743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.658918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.659602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.660022] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.660148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.660269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.660521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.660612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.660769] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.664945] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b654bc3a-4ad1-4684-8d04-9777d6265460 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.664945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b654bc3a-4ad1-4684-8d04-9777d6265460" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.664945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b654bc3a-4ad1-4684-8d04-9777d6265460" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.664945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b654bc3a-4ad1-4684-8d04-9777d6265460" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.664945] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b654bc3a-4ad1-4684-8d04-9777d6265460',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.950683] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.950928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.951035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.951225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.951397] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.951497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.951637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.951710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.951824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.951893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.952157] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.952266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.952325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.952490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.952720] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.952833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.953062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.953240] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.953321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.953424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.953516] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.166713] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.168096] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.168210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.168691] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b654bc3a-4ad1-4684-8d04-9777d6265460 with status ACTIVE [ 737.168780] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.168853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.168919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.169137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.169282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.169466] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.169466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.169676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.169676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.169765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.169935] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.170051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.170114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.170258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.170333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.170415] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b654bc3a-4ad1-4684-8d04-9777d6265460 is going to be updated. [ 737.193814] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.193814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.193814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.194035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.194172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.194325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b654bc3a-4ad1-4684-8d04-9777d6265460" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.202907] env[65899]: INFO networking_nsxv3.common.synchronization [req-708686bb-cb67-4228-ad37-9b663ac55e76 req-835d10fa-5ee1-4d2a-bda2-4cb9a561d215 tempest-ServersWithSpecificFlavorTestJSON-353865173 tempest-ServersWithSpecificFlavorTestJSON-353865173-project-member] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 737.202907] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 737.202907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.202907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.202907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.202907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.202907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.202907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.202907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.203335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.203335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.203335] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.458327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa6250d1-4a11-4b07-8308-040a7f86026a: rpc.has_security_group_logging(os_id): False [ 737.483081] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.483255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.483412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.483593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.483672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.483843] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.485718] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.485718] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.485718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.486264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.486264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.486264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.486264] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a is going to be updated. [ 737.560943] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.560943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.560943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.561320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.561425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.580348] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: IN_PROGRESS for 2s [ 737.599854] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.599854] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-739" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.599854] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-739" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.600274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-739" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.600566] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.600740] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.600852] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.601096] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.601241] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.601602] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.601730] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.601837] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.601977] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.602789] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.602993] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.603161] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.625713] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.625841] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.625926] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.626129] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-739" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.626441] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-51664afd-5f97-4dff-9219-a8502b1ac63a taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.626607] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-51664afd-5f97-4dff-9219-a8502b1ac63a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.626723] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-51664afd-5f97-4dff-9219-a8502b1ac63a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.627050] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-51664afd-5f97-4dff-9219-a8502b1ac63a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.627188] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51664afd-5f97-4dff-9219-a8502b1ac63a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.669431] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.705085] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.705305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.705362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.706048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.706048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.706048] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.706311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.706311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.706439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.706538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.706651] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 already deleted. [ 737.706761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.772962] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: SUCCESS [ 737.773452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.773774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.774077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.774353] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.774493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.774557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.774818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.774950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.775134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.775288] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.130517] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.130517] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.130517] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.130815] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.130815] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.131016] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 51664afd-5f97-4dff-9219-a8502b1ac63a not found, creating... [ 738.131141] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.131310] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.131412] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.131648] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.131766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.132161] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.132319] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.132429] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.132964] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.133166] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.133335] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 51664afd-5f97-4dff-9219-a8502b1ac63a is going to be created. [ 738.156068] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.156969] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.156969] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.156969] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.156969] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.157191] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-51664afd-5f97-4dff-9219-a8502b1ac63a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.172918] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.174611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.174611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.174611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.174611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.174611] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be created. [ 738.209114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.209320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.209407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.209637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.209835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.223025] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: UNINITIALIZED for 2s [ 738.278172] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.278442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.278799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.278799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.278981] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.279131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.279201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.279429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.279503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.279597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.279764] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.279860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.279927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.280097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.280250] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.280341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.280546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.280546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.280642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.280714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.280802] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.784793] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aea93861-5728-4289-9609-763ed4d27c02: rpc.has_security_group_logging(os_id): False [ 738.811407] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.811686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.811773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.812239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.812379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.812712] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.812898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.813354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.813631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.813775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.814148] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.814338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.814428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.814654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.814764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.815085] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.815226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.815312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.815519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.815623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.815744] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea93861-5728-4289-9609-763ed4d27c02 is going to be created. [ 738.930193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.930356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.930422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.930645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.930831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.946724] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: IN_PROGRESS for 2s [ 738.965503] env[65899]: INFO networking_nsxv3.common.synchronization [req-708686bb-cb67-4228-ad37-9b663ac55e76 req-766a7d5f-3e2c-420d-ad21-03b4a127d38e service nova] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_rules [ 738.965678] env[65899]: INFO networking_nsxv3.common.synchronization [req-708686bb-cb67-4228-ad37-9b663ac55e76 req-766a7d5f-3e2c-420d-ad21-03b4a127d38e service nova] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 738.965803] env[65899]: INFO networking_nsxv3.common.synchronization [req-708686bb-cb67-4228-ad37-9b663ac55e76 req-766a7d5f-3e2c-420d-ad21-03b4a127d38e service nova] Enqueued Resource ID: 51664afd-5f97-4dff-9219-a8502b1ac63a with Priority: HIGHEST for action port [ 738.966333] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_rules [ 738.966461] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 738.966551] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51664afd-5f97-4dff-9219-a8502b1ac63a with Priority: HIGHEST for action port [ 738.967303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.967456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.967522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.967766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.967817] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.969078] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.969237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.969648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.969844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.970011] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.970201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.970201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.970357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.970438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.970719] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.971520] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-51664afd-5f97-4dff-9219-a8502b1ac63a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.971520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51664afd-5f97-4dff-9219-a8502b1ac63a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.971666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51664afd-5f97-4dff-9219-a8502b1ac63a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.971731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51664afd-5f97-4dff-9219-a8502b1ac63a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.971807] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51664afd-5f97-4dff-9219-a8502b1ac63a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.121826] env[65899]: INFO networking_nsxv3.common.synchronization [req-529eacd5-15c9-47aa-97e6-77c71b5d8c8b req-025810ff-6f6f-4ded-bd49-72f9aef18083 tempest-SecurityGroupRulesTestJSON-609420685 tempest-SecurityGroupRulesTestJSON-609420685-project-member] Enqueued Resource ID: 0c5d7960-0818-436c-9b41-6fb6a508cbd9 with Priority: HIGHEST for action security_group_rules [ 739.122094] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c5d7960-0818-436c-9b41-6fb6a508cbd9 with Priority: HIGHEST for action security_group_rules [ 739.122419] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c5d7960-0818-436c-9b41-6fb6a508cbd9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.122550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c5d7960-0818-436c-9b41-6fb6a508cbd9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.122616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c5d7960-0818-436c-9b41-6fb6a508cbd9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.122866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c5d7960-0818-436c-9b41-6fb6a508cbd9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.122984] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c5d7960-0818-436c-9b41-6fb6a508cbd9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.474110] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.474601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.474864] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.477452] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51664afd-5f97-4dff-9219-a8502b1ac63a with status ACTIVE [ 739.477452] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.477452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.477452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.477452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.477452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.478912] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.478912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.478912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.479329] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.479417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.479616] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.479719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.479780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.479973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.480635] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.480830] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51664afd-5f97-4dff-9219-a8502b1ac63a is going to be updated. [ 739.504328] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.504494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.504551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.504752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.504915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.505104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51664afd-5f97-4dff-9219-a8502b1ac63a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.601624] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: SUCCESS [ 739.601814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.654125] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.654125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.654125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.654125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.654125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.654125] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c5d7960-0818-436c-9b41-6fb6a508cbd9 already deleted. [ 739.654125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c5d7960-0818-436c-9b41-6fb6a508cbd9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.983823] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.238913] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: SUCCESS [ 740.239342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.239342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.239565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.239821] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.240674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.240674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.240674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.240674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.240674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.240674] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.486502] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.486699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.486746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.487062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.487191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.487481] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be created. [ 740.516338] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.516594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.516733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.517631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.518063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.537824] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: UNINITIALIZED for 2s [ 740.743092] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.961505] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: SUCCESS [ 740.961719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.247315] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 743c5a69-4fa0-4875-ab4b-14b45b31c03c: rpc.has_security_group_logging(os_id): False [ 741.278187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.278703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.278792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.279026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.279111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.279380] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.279484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.279542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.279694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.279764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.279844] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be created. [ 741.399087] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.399301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.399345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.399758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.399758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.434517] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: IN_PROGRESS for 2s [ 742.189754] env[65899]: INFO networking_nsxv3.common.synchronization [req-2234da63-ee90-4e07-a8c4-6d131040abd9 req-a097c7d2-9563-47f5-941e-b0e244df56d4 tempest-SecurityGroupRulesNegativeTestJSON-1275890556 tempest-SecurityGroupRulesNegativeTestJSON-1275890556-project-member] Enqueued Resource ID: 89d3a02e-4e22-43af-a192-b5623af32b3b with Priority: HIGHEST for action security_group_rules [ 742.190255] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89d3a02e-4e22-43af-a192-b5623af32b3b with Priority: HIGHEST for action security_group_rules [ 742.190578] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89d3a02e-4e22-43af-a192-b5623af32b3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.190682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89d3a02e-4e22-43af-a192-b5623af32b3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.190778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89d3a02e-4e22-43af-a192-b5623af32b3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.191030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89d3a02e-4e22-43af-a192-b5623af32b3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.192339] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89d3a02e-4e22-43af-a192-b5623af32b3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.202591] env[65899]: INFO networking_nsxv3.common.synchronization [req-de3b1276-f1cc-4b3b-86fd-9284867adf99 req-c6e5159a-d98d-4c4e-83f1-91fed8165120 tempest-FloatingIPsAssociationTestJSON-926218692 tempest-FloatingIPsAssociationTestJSON-926218692-project-member] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 742.203036] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 742.206117] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.206117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.206117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.206117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.206117] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.206117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.206117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.206806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.206806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.206806] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.551096] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: SUCCESS [ 742.551391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.551572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.552696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.552904] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.554308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.554308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.554308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.554308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.554308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.554308] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.714989] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.714989] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.714989] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 already deleted. [ 742.714989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.718290] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.718477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.718543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.719029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.719029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.719029] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89d3a02e-4e22-43af-a192-b5623af32b3b already deleted. [ 742.719554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89d3a02e-4e22-43af-a192-b5623af32b3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.817639] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.818045] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-514" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.818625] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-514" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.818944] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-514" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.819565] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.819565] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.819820] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.819859] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.820018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.820278] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.820390] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.820522] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.820637] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.820796] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.820959] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.821180] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.847412] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.847703] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.847858] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.848121] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-514" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.848594] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-a5b8057b-000a-4c0d-a823-32721ee53908 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.848878] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-a5b8057b-000a-4c0d-a823-32721ee53908" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.850570] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-a5b8057b-000a-4c0d-a823-32721ee53908" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.851204] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-a5b8057b-000a-4c0d-a823-32721ee53908" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.851452] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5b8057b-000a-4c0d-a823-32721ee53908',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.056160] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.356543] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.356543] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.356543] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.356912] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.357228] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.357338] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port a5b8057b-000a-4c0d-a823-32721ee53908 not found, creating... [ 743.357678] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.358026] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.358234] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.358570] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.358957] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.359677] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.359789] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.359884] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.360181] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.360388] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.360714] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: a5b8057b-000a-4c0d-a823-32721ee53908 is going to be created. [ 743.383090] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.383325] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.383456] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.383820] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.384100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.384392] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-a5b8057b-000a-4c0d-a823-32721ee53908" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.449551] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: SUCCESS [ 743.449983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.558525] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6305f884-2f1c-4192-bb40-952ed6eaf542: rpc.has_security_group_logging(os_id): False [ 743.588424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.588623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.588727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.589038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.589165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.589463] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.589601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.589664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.589856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.589934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.589993] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be created. [ 743.778274] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.781449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.781449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.781449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.781449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.816901] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: IN_PROGRESS for 2s [ 744.174886] env[65899]: INFO networking_nsxv3.common.synchronization [req-de3b1276-f1cc-4b3b-86fd-9284867adf99 req-7e7b8380-aa4e-4615-9649-08fb98185090 service nova] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_rules [ 744.175068] env[65899]: INFO networking_nsxv3.common.synchronization [req-de3b1276-f1cc-4b3b-86fd-9284867adf99 req-7e7b8380-aa4e-4615-9649-08fb98185090 service nova] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 744.175202] env[65899]: INFO networking_nsxv3.common.synchronization [req-de3b1276-f1cc-4b3b-86fd-9284867adf99 req-7e7b8380-aa4e-4615-9649-08fb98185090 service nova] Enqueued Resource ID: a5b8057b-000a-4c0d-a823-32721ee53908 with Priority: HIGHEST for action port [ 744.175963] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_rules [ 744.176218] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 744.176385] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5b8057b-000a-4c0d-a823-32721ee53908 with Priority: HIGHEST for action port [ 744.176683] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.176843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.176983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.177381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.177535] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.179031] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.179175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.179271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.179556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.179750] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.179954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.180077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.180267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.180629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.180629] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.181501] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5b8057b-000a-4c0d-a823-32721ee53908 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.181708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5b8057b-000a-4c0d-a823-32721ee53908" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.181808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5b8057b-000a-4c0d-a823-32721ee53908" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.182035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5b8057b-000a-4c0d-a823-32721ee53908" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.182156] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5b8057b-000a-4c0d-a823-32721ee53908',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.685343] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.685725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.685725] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.688753] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5b8057b-000a-4c0d-a823-32721ee53908 with status ACTIVE [ 744.688753] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.688753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.688753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.688753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.688753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.689115] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.689115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.689115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.689281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.689281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.689438] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.689537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.689592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.689732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.689789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.689871] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5b8057b-000a-4c0d-a823-32721ee53908 is going to be updated. [ 744.725438] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.725769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.725858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.726083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.726280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.726381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5b8057b-000a-4c0d-a823-32721ee53908" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.137367] env[65899]: INFO networking_nsxv3.common.synchronization [req-fbdf1cbd-5f4f-4670-b83b-9b48a27ce846 req-f2f4b589-957f-48e6-a98b-1316dddf9556 tempest-DeleteServersAdminTestJSON-1955726497 tempest-DeleteServersAdminTestJSON-1955726497-project-member] Enqueued Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 745.137607] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 745.137885] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.138017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.139291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.142460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.142460] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.142460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.142460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.142460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.142460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.142460] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.194018] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.560416] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.560645] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.560764] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.561109] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.561407] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.561562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.561670] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.561929] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.562333] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.563631] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.563631] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.563631] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.563631] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.563631] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.563631] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.563631] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.584314] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.584440] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.584492] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.584767] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.585065] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-d667127a-e02f-4dc1-bce1-e07699cfeb60 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.585594] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-d667127a-e02f-4dc1-bce1-e07699cfeb60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.585594] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-d667127a-e02f-4dc1-bce1-e07699cfeb60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.585740] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-d667127a-e02f-4dc1-bce1-e07699cfeb60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.586198] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d667127a-e02f-4dc1-bce1-e07699cfeb60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.643950] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.644135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.644710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.644710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.644805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.645008] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.645139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.645217] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.646081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.646081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.646081] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 is going to be updated. [ 745.696577] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.697038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.697038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.697188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.697325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.697385] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 is going to be created. [ 745.714558] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.714558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.714890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.714890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.715077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.727754] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: IN_PROGRESS for 2s [ 745.736458] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.736700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.736700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.736921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.737284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.756069] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: UNINITIALIZED for 2s [ 745.834846] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: SUCCESS [ 745.835149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.088556] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.088802] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.089076] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.089468] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.089628] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.089787] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port d667127a-e02f-4dc1-bce1-e07699cfeb60 not found, creating... [ 746.090331] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.090558] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.090695] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.090985] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.091182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.091526] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.091718] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.091868] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.092453] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.092671] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.092841] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: d667127a-e02f-4dc1-bce1-e07699cfeb60 is going to be created. [ 746.123161] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.123459] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.123580] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.123883] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.124268] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.124570] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-d667127a-e02f-4dc1-bce1-e07699cfeb60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.015411] env[65899]: INFO networking_nsxv3.common.synchronization [req-fbdf1cbd-5f4f-4670-b83b-9b48a27ce846 req-6927d73f-a6f0-4f64-9645-443a3a426b33 service nova] Enqueued Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_rules [ 747.015746] env[65899]: INFO networking_nsxv3.common.synchronization [req-fbdf1cbd-5f4f-4670-b83b-9b48a27ce846 req-6927d73f-a6f0-4f64-9645-443a3a426b33 service nova] Enqueued Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 747.015791] env[65899]: INFO networking_nsxv3.common.synchronization [req-fbdf1cbd-5f4f-4670-b83b-9b48a27ce846 req-6927d73f-a6f0-4f64-9645-443a3a426b33 service nova] Enqueued Resource ID: d667127a-e02f-4dc1-bce1-e07699cfeb60 with Priority: HIGHEST for action port [ 747.016612] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_rules [ 747.016802] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 747.017053] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d667127a-e02f-4dc1-bce1-e07699cfeb60 with Priority: HIGHEST for action port [ 747.017713] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.017883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.017992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.018336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.018473] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.019875] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.019954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.020212] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-d667127a-e02f-4dc1-bce1-e07699cfeb60 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.020325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d667127a-e02f-4dc1-bce1-e07699cfeb60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.020403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d667127a-e02f-4dc1-bce1-e07699cfeb60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.020600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d667127a-e02f-4dc1-bce1-e07699cfeb60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.020679] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d667127a-e02f-4dc1-bce1-e07699cfeb60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.522477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.522741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.522881] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d667127a-e02f-4dc1-bce1-e07699cfeb60 with status ACTIVE [ 747.523147] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.523320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.523320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.523967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.523967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.523967] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.523967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.524216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.524216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.524345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.524663] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.524663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.524872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.524872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.525374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.525374] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d667127a-e02f-4dc1-bce1-e07699cfeb60 is going to be updated. [ 747.557417] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.557580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.557695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.557894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.558058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.558259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d667127a-e02f-4dc1-bce1-e07699cfeb60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.743048] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: SUCCESS [ 747.743048] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 deletion is rescheduled due to dependency. [ 747.743048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.743048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.743048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.743048] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.743048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.744288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.744778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.745141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.745556] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.769426] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: SUCCESS [ 747.771188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.771188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.771188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.771188] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.771188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.771188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.771188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.771675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.771675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.771675] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.816717] env[65899]: INFO networking_nsxv3.common.synchronization [None req-7075a253-b991-4d6a-a89e-4c1ad27df251 None None] Enqueued Resource ID: e57da82d-8799-4e1a-85ab-2ea3739e4f88 with Priority: HIGHEST for action port [ 747.817354] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e57da82d-8799-4e1a-85ab-2ea3739e4f88 with Priority: HIGHEST for action port [ 747.817754] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e57da82d-8799-4e1a-85ab-2ea3739e4f88 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.817931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e57da82d-8799-4e1a-85ab-2ea3739e4f88" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.818062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e57da82d-8799-4e1a-85ab-2ea3739e4f88" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.818394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e57da82d-8799-4e1a-85ab-2ea3739e4f88" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.818475] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e57da82d-8799-4e1a-85ab-2ea3739e4f88',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.248679] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.278027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.278027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.278027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.278027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.278027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.279202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.279202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.279202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.279202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.279202] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.320816] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e57da82d-8799-4e1a-85ab-2ea3739e4f88 [ 748.321064] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.321196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.321266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.321489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.321580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.321668] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e57da82d-8799-4e1a-85ab-2ea3739e4f88 already deleted. [ 748.321744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e57da82d-8799-4e1a-85ab-2ea3739e4f88" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.756749] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.782092] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58bb0b54-538c-449e-bd48-369e68a81947: rpc.has_security_group_logging(os_id): False [ 748.807021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.807021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.807021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.807021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.807805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.807805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.807805] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.807805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.807968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.808058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.808154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.808253] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 is going to be created. [ 748.877307] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.877539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.877539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.877796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.879302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.897622] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: IN_PROGRESS for 2s [ 749.052421] env[65899]: INFO networking_nsxv3.common.synchronization [req-5d14fe51-3dd4-4973-9723-69b188b113e8 req-72370540-602e-4206-97e2-afb7911ea8b1 tempest-SecurityGroupRulesTestJSON-609420685 tempest-SecurityGroupRulesTestJSON-609420685-project-member] Enqueued Resource ID: bb714dbe-777f-4f03-9f79-2d03e1de8561 with Priority: HIGHEST for action security_group_rules [ 749.052421] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb714dbe-777f-4f03-9f79-2d03e1de8561 with Priority: HIGHEST for action security_group_rules [ 749.052421] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb714dbe-777f-4f03-9f79-2d03e1de8561 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.052772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb714dbe-777f-4f03-9f79-2d03e1de8561" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.053049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb714dbe-777f-4f03-9f79-2d03e1de8561" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.053864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb714dbe-777f-4f03-9f79-2d03e1de8561" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.054272] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb714dbe-777f-4f03-9f79-2d03e1de8561',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.262448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.262846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.262846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.263804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.263862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.264800] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 is going to be updated. [ 749.299504] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.300155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.300155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.300155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.300155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.312017] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: IN_PROGRESS for 2s [ 749.576953] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.576953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.577212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.577265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.577533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.577533] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb714dbe-777f-4f03-9f79-2d03e1de8561 already deleted. [ 749.577533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb714dbe-777f-4f03-9f79-2d03e1de8561" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.781917] env[65899]: INFO networking_nsxv3.common.synchronization [None req-267cadda-eb27-4756-ba72-dd814b6e5319 None None] Enqueued Resource ID: 41a20a8a-c111-466e-8a4e-4d7281160c3a with Priority: HIGHEST for action port [ 749.782518] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41a20a8a-c111-466e-8a4e-4d7281160c3a with Priority: HIGHEST for action port [ 749.782815] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-41a20a8a-c111-466e-8a4e-4d7281160c3a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.782975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41a20a8a-c111-466e-8a4e-4d7281160c3a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.783163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41a20a8a-c111-466e-8a4e-4d7281160c3a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.783467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41a20a8a-c111-466e-8a4e-4d7281160c3a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.783614] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41a20a8a-c111-466e-8a4e-4d7281160c3a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.151346] env[65899]: INFO networking_nsxv3.common.synchronization [req-24d8bf50-d74b-484b-bd55-5afa97d710c5 req-975e97e0-0774-4952-b00d-6c8f9b62d458 tempest-SecurityGroupRulesNegativeTestJSON-1275890556 tempest-SecurityGroupRulesNegativeTestJSON-1275890556-project-member] Enqueued Resource ID: 89d3a02e-4e22-43af-a192-b5623af32b3b with Priority: HIGHEST for action security_group_rules [ 750.151907] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89d3a02e-4e22-43af-a192-b5623af32b3b with Priority: HIGHEST for action security_group_rules [ 750.152385] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89d3a02e-4e22-43af-a192-b5623af32b3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.152488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89d3a02e-4e22-43af-a192-b5623af32b3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.152552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89d3a02e-4e22-43af-a192-b5623af32b3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.152755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89d3a02e-4e22-43af-a192-b5623af32b3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.152843] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89d3a02e-4e22-43af-a192-b5623af32b3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.288623] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41a20a8a-c111-466e-8a4e-4d7281160c3a [ 750.289038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.289038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.289220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.289567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.289567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.289567] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41a20a8a-c111-466e-8a4e-4d7281160c3a already deleted. [ 750.289718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41a20a8a-c111-466e-8a4e-4d7281160c3a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.338465] env[65899]: INFO networking_nsxv3.common.synchronization [None req-6f1776d5-5b06-4707-bf0d-511f05a86612 None None] Enqueued Resource ID: 5e05246a-79ab-48fb-a58b-748f66e2b22a with Priority: HIGHEST for action port [ 750.339491] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e05246a-79ab-48fb-a58b-748f66e2b22a with Priority: HIGHEST for action port [ 750.339892] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e05246a-79ab-48fb-a58b-748f66e2b22a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.340146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e05246a-79ab-48fb-a58b-748f66e2b22a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.340393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e05246a-79ab-48fb-a58b-748f66e2b22a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.340805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e05246a-79ab-48fb-a58b-748f66e2b22a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.340944] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e05246a-79ab-48fb-a58b-748f66e2b22a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.677506] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.677688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.677741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.680298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.680298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.680298] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89d3a02e-4e22-43af-a192-b5623af32b3b already deleted. [ 750.680298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89d3a02e-4e22-43af-a192-b5623af32b3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.844924] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e05246a-79ab-48fb-a58b-748f66e2b22a [ 750.844924] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.844924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.844924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.844924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.844924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.844924] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e05246a-79ab-48fb-a58b-748f66e2b22a already deleted. [ 750.844924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e05246a-79ab-48fb-a58b-748f66e2b22a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.911039] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: SUCCESS [ 750.911039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.324332] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: SUCCESS [ 751.324332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.324332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.325519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.325519] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.325679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.326281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.326281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.326281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.326281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.326281] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.479236] env[65899]: INFO networking_nsxv3.common.synchronization [req-d16f8859-87ec-4a1c-80c8-3a7ae9e3b3c4 req-3226e15f-3167-467c-b6cc-75e3c8a364cc tempest-ServerExternalEventsTest-1643309741 tempest-ServerExternalEventsTest-1643309741-project-member] Enqueued Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGHEST for action security_group_members [ 751.479236] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGHEST for action security_group_members [ 751.479236] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb53a98-d213-45f3-8ad2-09830fe9ee60 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.479236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.479236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.479236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.479236] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.479236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.479236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.479236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.479236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.479236] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.828931] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.829120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.829120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.829380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.829557] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.829666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.829729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.829891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.829987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.830152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.830333] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.830432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.830543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.830665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.830809] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.830902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.830962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.831151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.831236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.831321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.831428] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.986147] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.986147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.986147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.986657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.986657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.986657] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.986657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.986657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.986965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.986965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.987077] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 already deleted. [ 751.987456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.020233] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.020233] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.021506] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.021506] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.021618] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.021999] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.021999] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.022721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.022721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.023489] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.023489] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.023489] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.023489] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.023952] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.024085] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.024296] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.050714] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.050919] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.051125] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.051504] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.051650] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-fb037d2b-584f-4f6c-bf25-422d74864f46 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.052407] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-fb037d2b-584f-4f6c-bf25-422d74864f46" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.054084] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-fb037d2b-584f-4f6c-bf25-422d74864f46" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.056075] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-fb037d2b-584f-4f6c-bf25-422d74864f46" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.056075] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb037d2b-584f-4f6c-bf25-422d74864f46',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.337780] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6efcb92-8e15-4172-8949-8449dfa15fb3: rpc.has_security_group_logging(os_id): False [ 752.361279] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.361785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.361989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.363327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.363327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.363327] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.363327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.363327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.363327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.363327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.366820] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.366820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.366820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.366820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.366820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.366820] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.366820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.366820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.366820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.366820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.366820] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 is going to be updated. [ 752.505970] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.505970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.505970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.505970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.505970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.521701] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: IN_PROGRESS for 2s [ 752.562445] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.562764] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.562764] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.563311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.563311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.563421] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port fb037d2b-584f-4f6c-bf25-422d74864f46 not found, creating... [ 752.564362] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.564362] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.564362] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.564362] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.564362] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.564826] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.564826] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.564826] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.565098] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.565845] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.566934] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: fb037d2b-584f-4f6c-bf25-422d74864f46 is going to be created. [ 752.594448] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.594448] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.594448] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.594448] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.594448] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.594448] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-fb037d2b-584f-4f6c-bf25-422d74864f46" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.378321] env[65899]: INFO networking_nsxv3.common.synchronization [req-d16f8859-87ec-4a1c-80c8-3a7ae9e3b3c4 req-3772cbc2-7904-4759-ab04-e9a6ad6c547d service nova] Enqueued Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGHEST for action security_group_rules [ 753.378321] env[65899]: INFO networking_nsxv3.common.synchronization [req-d16f8859-87ec-4a1c-80c8-3a7ae9e3b3c4 req-3772cbc2-7904-4759-ab04-e9a6ad6c547d service nova] Enqueued Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGHEST for action security_group_members [ 753.378321] env[65899]: INFO networking_nsxv3.common.synchronization [req-d16f8859-87ec-4a1c-80c8-3a7ae9e3b3c4 req-3772cbc2-7904-4759-ab04-e9a6ad6c547d service nova] Enqueued Resource ID: fb037d2b-584f-4f6c-bf25-422d74864f46 with Priority: HIGHEST for action port [ 753.378321] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGHEST for action security_group_rules [ 753.378321] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGHEST for action security_group_members [ 753.378321] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb037d2b-584f-4f6c-bf25-422d74864f46 with Priority: HIGHEST for action port [ 753.378753] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.378753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.378753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.379017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.379017] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.379926] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb53a98-d213-45f3-8ad2-09830fe9ee60 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.380050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.380138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.380316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.380512] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.380574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.380611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.380744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.380834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.380963] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.381758] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb037d2b-584f-4f6c-bf25-422d74864f46 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.381866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb037d2b-584f-4f6c-bf25-422d74864f46" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.381930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb037d2b-584f-4f6c-bf25-422d74864f46" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.382139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb037d2b-584f-4f6c-bf25-422d74864f46" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.382212] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb037d2b-584f-4f6c-bf25-422d74864f46',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.883587] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb53a98-d213-45f3-8ad2-09830fe9ee60 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.884421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.885123] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.888212] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb037d2b-584f-4f6c-bf25-422d74864f46 with status ACTIVE [ 753.888212] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.888212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.888212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.888212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.888212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.888212] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.888212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.888212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.888212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.888212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.888212] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.890256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.890256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.890256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.890256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.890256] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb037d2b-584f-4f6c-bf25-422d74864f46 is going to be updated. [ 753.930547] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.930547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.930547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.930547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.930547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.930547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb037d2b-584f-4f6c-bf25-422d74864f46" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.392225] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.540549] env[65899]: INFO networking_nsxv3.common.synchronization [req-5d9a9c97-ce2d-4763-ba09-4e4678f9fa75 req-87a9be0c-8a7a-498e-85eb-3a5a5d7882ad tempest-SecurityGroupRulesTestJSON-609420685 tempest-SecurityGroupRulesTestJSON-609420685-project-member] Enqueued Resource ID: 184bacba-c599-434c-9b78-a211aaec153c with Priority: HIGHEST for action security_group_rules [ 754.542392] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: SUCCESS [ 754.543106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.543969] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 184bacba-c599-434c-9b78-a211aaec153c with Priority: HIGHEST for action security_group_rules [ 754.544459] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-184bacba-c599-434c-9b78-a211aaec153c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.544707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-184bacba-c599-434c-9b78-a211aaec153c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.544972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-184bacba-c599-434c-9b78-a211aaec153c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.548661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-184bacba-c599-434c-9b78-a211aaec153c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.548661] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('184bacba-c599-434c-9b78-a211aaec153c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.563691] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0c53a307-6402-4f6a-9037-aeffaedfc8e8 None None] Enqueued Resource ID: 248cba98-c318-48e9-a869-44bfcf192503 with Priority: HIGHEST for action port [ 754.564421] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 248cba98-c318-48e9-a869-44bfcf192503 with Priority: HIGHEST for action port [ 754.564802] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-248cba98-c318-48e9-a869-44bfcf192503 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.564937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-248cba98-c318-48e9-a869-44bfcf192503" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.565046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-248cba98-c318-48e9-a869-44bfcf192503" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.565831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-248cba98-c318-48e9-a869-44bfcf192503" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.565831] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('248cba98-c318-48e9-a869-44bfcf192503',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.895668] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.895954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.895954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.896572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.896572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.896572] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 is going to be created. [ 754.927258] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.927445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.927445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.927662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.927823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.939143] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 in Status: UNINITIALIZED for 2s [ 755.069676] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 248cba98-c318-48e9-a869-44bfcf192503 [ 755.070195] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.070195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.070195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.070406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.070406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.070501] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:248cba98-c318-48e9-a869-44bfcf192503 already deleted. [ 755.070594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-248cba98-c318-48e9-a869-44bfcf192503" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.075420] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.075565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.075744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.075986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.075986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.076197] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 184bacba-c599-434c-9b78-a211aaec153c already deleted. [ 755.076197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-184bacba-c599-434c-9b78-a211aaec153c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.951396] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 in Status: SUCCESS [ 756.951694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.951791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.952096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.952359] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.952488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.952557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.952729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.952813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.952899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.952997] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.456666] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb53a98-d213-45f3-8ad2-09830fe9ee60 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.456827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.456892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.457131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.457309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.457411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.457502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.457717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.457850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.457997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.458271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb53a98-d213-45f3-8ad2-09830fe9ee60 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.458384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.458448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.458598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.458746] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.458835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.458993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.459159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.459238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.459320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.459410] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.963785] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccb53a98-d213-45f3-8ad2-09830fe9ee60: rpc.has_security_group_logging(os_id): False [ 757.991876] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.991876] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.991876] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.991876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.992722] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.992722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.992722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.992722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.992722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.992722] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 is going to be created. [ 758.076903] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.076903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.076903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.077363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.077565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.092071] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 in Status: IN_PROGRESS for 2s [ 758.350013] env[65899]: INFO networking_nsxv3.common.synchronization [req-08898528-0be5-40a8-b01e-f7c5bd225942 req-8471db9b-a3d7-44df-b650-ff6435101925 tempest-ServerMetadataNegativeTestJSON-683911506 tempest-ServerMetadataNegativeTestJSON-683911506-project-member] Enqueued Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGHEST for action security_group_members [ 758.350526] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGHEST for action security_group_members [ 758.350760] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ebe8c18-10e1-409f-82d4-0340ed451137 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.350879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.350976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.352359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.353602] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.353602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.353602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.353870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.353870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.353870] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.856536] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.856839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.857937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.857937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.857937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.858406] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.858681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.858793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.859147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.859832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.860641] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 already deleted. [ 758.860641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.116922] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-951 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.117349] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-951" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.117349] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-951" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.119853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-951" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.119853] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.119853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.119853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.119853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.119853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.119853] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.119853] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.119853] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.119853] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.119853] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.119853] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.119853] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.143239] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.143411] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.143576] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.143756] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-951" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.144119] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.144316] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.144438] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.144797] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.144928] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a3d4b1-0b86-4bd1-9bcf-86d891b0c028',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.482034] env[65899]: INFO networking_nsxv3.common.synchronization [None req-62191e66-0cf3-4632-8016-825460e00b58 None None] Enqueued Resource ID: 6d3f4f1a-054d-4e3d-98e0-c645a947e232 with Priority: HIGHEST for action port [ 759.482796] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3f4f1a-054d-4e3d-98e0-c645a947e232 with Priority: HIGHEST for action port [ 759.483160] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d3f4f1a-054d-4e3d-98e0-c645a947e232 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.483372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d3f4f1a-054d-4e3d-98e0-c645a947e232" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.483477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d3f4f1a-054d-4e3d-98e0-c645a947e232" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.483790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d3f4f1a-054d-4e3d-98e0-c645a947e232" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.483865] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d3f4f1a-054d-4e3d-98e0-c645a947e232',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.648557] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.648812] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.648956] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.649300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.649481] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.649654] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 48a3d4b1-0b86-4bd1-9bcf-86d891b0c028 not found, creating... [ 759.649958] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.650156] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.650292] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.650534] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.650687] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.651395] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.654303] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.654303] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.654303] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.654303] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.654303] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 48a3d4b1-0b86-4bd1-9bcf-86d891b0c028 is going to be created. [ 759.673896] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.674127] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.674256] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.674558] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.674785] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.675016] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.986431] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d3f4f1a-054d-4e3d-98e0-c645a947e232 [ 759.986700] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.986866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.986957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.987268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.987426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.987485] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d3f4f1a-054d-4e3d-98e0-c645a947e232 already deleted. [ 759.987550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d3f4f1a-054d-4e3d-98e0-c645a947e232" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.110237] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 in Status: SUCCESS [ 760.110237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.471797] env[65899]: INFO networking_nsxv3.common.synchronization [req-08898528-0be5-40a8-b01e-f7c5bd225942 req-42f08654-c75d-44e7-a142-31f52552fb19 service nova] Enqueued Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGHEST for action security_group_rules [ 760.471797] env[65899]: INFO networking_nsxv3.common.synchronization [req-08898528-0be5-40a8-b01e-f7c5bd225942 req-42f08654-c75d-44e7-a142-31f52552fb19 service nova] Enqueued Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGHEST for action security_group_members [ 760.471797] env[65899]: INFO networking_nsxv3.common.synchronization [req-08898528-0be5-40a8-b01e-f7c5bd225942 req-42f08654-c75d-44e7-a142-31f52552fb19 service nova] Enqueued Resource ID: 48a3d4b1-0b86-4bd1-9bcf-86d891b0c028 with Priority: HIGHEST for action port [ 760.473474] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGHEST for action security_group_rules [ 760.475372] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGHEST for action security_group_members [ 760.475826] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a3d4b1-0b86-4bd1-9bcf-86d891b0c028 with Priority: HIGHEST for action port [ 760.476202] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ebe8c18-10e1-409f-82d4-0340ed451137 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.476530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.476530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.476809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.476938] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.478138] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ebe8c18-10e1-409f-82d4-0340ed451137 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.478616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.478724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.478955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.479184] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.479318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.479400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.479567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.479721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.480140] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.481100] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.481628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.481628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.481628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.481628] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48a3d4b1-0b86-4bd1-9bcf-86d891b0c028',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.907722] env[65899]: INFO networking_nsxv3.common.synchronization [req-643eec9a-2677-4e90-989d-490fd62f9d56 req-7a39212e-c5b0-4f90-a9c4-3a02e5f88208 tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 760.908248] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 760.908553] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.909143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.909143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.909143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.909338] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.909515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.909575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.909729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.909804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.909892] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.983924] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.984725] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ebe8c18-10e1-409f-82d4-0340ed451137 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.984849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.984986] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48a3d4b1-0b86-4bd1-9bcf-86d891b0c028 with status ACTIVE [ 760.985158] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.985261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.985320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.985527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.985605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.985805] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.985897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.985986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.987451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.987495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.987693] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.987809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.987877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.988026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.988094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.989467] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48a3d4b1-0b86-4bd1-9bcf-86d891b0c028 is going to be updated. [ 761.014537] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.014537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.014537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.014537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.014537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.014537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48a3d4b1-0b86-4bd1-9bcf-86d891b0c028" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.412391] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.412599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.412650] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.412829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.413761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.413761] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.413761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.413761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.413761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.413761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.413761] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 761.466121] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.466275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.466328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.466533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.466698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.482621] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 761.492332] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.865978] env[65899]: INFO networking_nsxv3.common.synchronization [None req-ead1f9f4-a248-4b57-9be5-1d71bb25d39e None None] Enqueued Resource ID: 7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5 with Priority: HIGHEST for action port [ 761.866985] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5 with Priority: HIGHEST for action port [ 761.867790] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.868484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.868484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.868484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.868484] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.996460] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.996733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.996899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.997453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.997453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.997453] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 is going to be created. [ 762.026602] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.026796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.026868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.027062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.027262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.042064] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 in Status: UNINITIALIZED for 2s [ 762.371743] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5 [ 762.372550] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.372550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.372550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.372810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.372810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.372921] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5 already deleted. [ 762.373245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7af89899-44e6-47a9-b7ad-9dcd6bd5a5c5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.671608] env[65899]: INFO networking_nsxv3.common.synchronization [None req-39361f8f-e84e-42bc-a2db-f8b4027b7cfe None None] Enqueued Resource ID: 1e26780b-3548-4c32-a1b9-d5ba795be55b with Priority: HIGHEST for action port [ 762.672159] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e26780b-3548-4c32-a1b9-d5ba795be55b with Priority: HIGHEST for action port [ 762.672490] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e26780b-3548-4c32-a1b9-d5ba795be55b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.672614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e26780b-3548-4c32-a1b9-d5ba795be55b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.672675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e26780b-3548-4c32-a1b9-d5ba795be55b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.673270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e26780b-3548-4c32-a1b9-d5ba795be55b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.673390] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e26780b-3548-4c32-a1b9-d5ba795be55b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.180026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e26780b-3548-4c32-a1b9-d5ba795be55b [ 763.180286] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.181179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.181179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.181179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.181179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.181179] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e26780b-3548-4c32-a1b9-d5ba795be55b already deleted. [ 763.181179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e26780b-3548-4c32-a1b9-d5ba795be55b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.494620] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 763.494799] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 deletion is rescheduled due to dependency. [ 763.494909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.057177] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 in Status: SUCCESS [ 764.057177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.057177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.057177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.057177] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.057177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.057177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.057177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.057177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.057177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.057177] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.559957] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ebe8c18-10e1-409f-82d4-0340ed451137 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.559957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.559957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.559957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.559957] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.559957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.560533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.560533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.560533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.560533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.560533] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ebe8c18-10e1-409f-82d4-0340ed451137 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.560866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.560866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.560866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.561088] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.561171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.561171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.561306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.561406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.561480] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.561620] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.056513] env[65899]: INFO networking_nsxv3.common.synchronization [req-894898dd-c861-4424-aa8d-938eb86c9656 req-5f057bd3-be18-4662-8b4f-39005b4dd491 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 765.057420] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 765.057978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.059450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.059658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.060223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.060503] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.060704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.060704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.061082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.061293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.061668] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.063091] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ebe8c18-10e1-409f-82d4-0340ed451137: rpc.has_security_group_logging(os_id): False [ 765.083745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.084325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.084489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.084730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.084838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.085084] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.085197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.085270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.085420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.085498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.085705] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.085792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.085853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.086579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.086579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.086962] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.087429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.087429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.087825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.087951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.088099] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 is going to be created. [ 765.158429] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.158621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.158774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.159093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.159396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.173017] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 in Status: IN_PROGRESS for 2s [ 765.179652] env[65899]: INFO networking_nsxv3.common.synchronization [req-9cf48408-2068-4ebd-bec5-c2ac99a727da req-3f0e13f2-831a-47b9-bd42-e0b52938838e tempest-ServersTestManualDisk-1669787664 tempest-ServersTestManualDisk-1669787664-project-member] Enqueued Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_members [ 765.180995] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad04559-d224-486f-adbe-3d9a2df06d0a with Priority: HIGHEST for action security_group_members [ 765.181710] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dad04559-d224-486f-adbe-3d9a2df06d0a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.181860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.181931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.182166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.182412] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.182585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.182585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.182741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.182852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.183122] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dad04559-d224-486f-adbe-3d9a2df06d0a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.372286] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c17b64ac-2e0b-461e-9776-1c9dcb91f211 None None] Enqueued Resource ID: 2ae96f0f-2050-493b-b6d0-3194e8eeffc5 with Priority: HIGHEST for action port [ 765.372286] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae96f0f-2050-493b-b6d0-3194e8eeffc5 with Priority: HIGHEST for action port [ 765.373404] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ae96f0f-2050-493b-b6d0-3194e8eeffc5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.373706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ae96f0f-2050-493b-b6d0-3194e8eeffc5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.373956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ae96f0f-2050-493b-b6d0-3194e8eeffc5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.374327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ae96f0f-2050-493b-b6d0-3194e8eeffc5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.374723] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ae96f0f-2050-493b-b6d0-3194e8eeffc5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.439316] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.439456] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.439561] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.439884] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.440165] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.440309] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.440416] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.440629] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.440764] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.440958] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.441261] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 765.441389] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 765.441505] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 765.441678] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.441853] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 765.442097] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 765.465511] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 765.465755] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 765.465904] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 765.466089] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.466390] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-dc0537e1-dba7-4825-8e34-9c03f0cd454d taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.466591] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-dc0537e1-dba7-4825-8e34-9c03f0cd454d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.466674] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-dc0537e1-dba7-4825-8e34-9c03f0cd454d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.466979] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-dc0537e1-dba7-4825-8e34-9c03f0cd454d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.467121] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc0537e1-dba7-4825-8e34-9c03f0cd454d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.564087] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.565026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.565026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.565026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.565026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.565026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.565026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.565026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.565452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.565452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.565452] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d already deleted. [ 765.565452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.684862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.685060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.685126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.685352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.685438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.685629] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.685715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.685774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.685922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.686915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.686915] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad04559-d224-486f-adbe-3d9a2df06d0a is going to be updated. [ 765.715452] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.715654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.715654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.715871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.716007] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.725548] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad04559-d224-486f-adbe-3d9a2df06d0a in Status: IN_PROGRESS for 2s [ 765.879692] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ae96f0f-2050-493b-b6d0-3194e8eeffc5 [ 765.879692] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.879692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.879692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.879692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.879692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.879692] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ae96f0f-2050-493b-b6d0-3194e8eeffc5 already deleted. [ 765.879692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ae96f0f-2050-493b-b6d0-3194e8eeffc5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.971100] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.971100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.971100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.971437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.971640] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.971640] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port dc0537e1-dba7-4825-8e34-9c03f0cd454d not found, creating... [ 765.971985] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.972099] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.972143] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.972408] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.972525] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.972799] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.972954] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.973156] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.973313] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.973497] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.973637] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: dc0537e1-dba7-4825-8e34-9c03f0cd454d is going to be created. [ 765.993759] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.993947] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.994077] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.994348] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.994583] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.994807] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-dc0537e1-dba7-4825-8e34-9c03f0cd454d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.178153] env[65899]: INFO networking_nsxv3.common.synchronization [req-243e68fc-bef4-4c67-83c6-6e919be13d8d req-a43b65b3-c63a-47dd-af8d-2c47ec75995f tempest-SecurityGroupRulesTestJSON-609420685 tempest-SecurityGroupRulesTestJSON-609420685-project-member] Enqueued Resource ID: a0a6e106-8e21-42f0-988d-bba37739fddb with Priority: HIGHEST for action security_group_rules [ 766.179111] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6e106-8e21-42f0-988d-bba37739fddb with Priority: HIGHEST for action security_group_rules [ 766.179591] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a6e106-8e21-42f0-988d-bba37739fddb taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.181267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.181267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.181267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.181267] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a6e106-8e21-42f0-988d-bba37739fddb',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.671471] env[65899]: INFO networking_nsxv3.common.synchronization [None req-066befcf-bec9-4cfd-ba09-54f10a8d8747 tempest-AttachVolumeShelveTestJSON-1192841755 tempest-AttachVolumeShelveTestJSON-1192841755-project-member] Enqueued Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_rules [ 766.671471] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_rules [ 766.671471] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.671471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.671471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.671471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.671471] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.692839] env[65899]: INFO networking_nsxv3.common.synchronization [req-894898dd-c861-4424-aa8d-938eb86c9656 req-d69b77aa-b2c8-461e-93d7-b30a03679aaf service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 766.693152] env[65899]: INFO networking_nsxv3.common.synchronization [req-894898dd-c861-4424-aa8d-938eb86c9656 req-d69b77aa-b2c8-461e-93d7-b30a03679aaf service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 766.693152] env[65899]: INFO networking_nsxv3.common.synchronization [req-894898dd-c861-4424-aa8d-938eb86c9656 req-d69b77aa-b2c8-461e-93d7-b30a03679aaf service nova] Enqueued Resource ID: dc0537e1-dba7-4825-8e34-9c03f0cd454d with Priority: HIGHEST for action port [ 766.694247] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 766.694437] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 766.694564] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc0537e1-dba7-4825-8e34-9c03f0cd454d with Priority: HIGHEST for action port [ 766.694889] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.695074] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.695196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.695502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.695559] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.696690] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.696898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.696997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.697243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.697435] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.697561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.697640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.697866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.698056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.698115] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.699439] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc0537e1-dba7-4825-8e34-9c03f0cd454d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.699604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc0537e1-dba7-4825-8e34-9c03f0cd454d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.700457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc0537e1-dba7-4825-8e34-9c03f0cd454d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.700457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc0537e1-dba7-4825-8e34-9c03f0cd454d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.700457] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc0537e1-dba7-4825-8e34-9c03f0cd454d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.705140] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.705140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.705140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.705140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.705140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.705140] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a6e106-8e21-42f0-988d-bba37739fddb already deleted. [ 766.705140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.807134] env[65899]: INFO networking_nsxv3.common.synchronization [None req-5c24f2ff-7046-4d64-a4d7-00b614fd0697 tempest-AttachVolumeShelveTestJSON-1192841755 tempest-AttachVolumeShelveTestJSON-1192841755-project-member] Enqueued Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_rules [ 766.807939] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_rules [ 766.808280] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.808385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.186635] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 in Status: SUCCESS [ 767.186964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.193982] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.194147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.194215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.194459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.194627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.194728] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f already deleted. [ 767.195062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.195062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.195143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.195213] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.201990] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.203349] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.203509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.203731] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc0537e1-dba7-4825-8e34-9c03f0cd454d with status ACTIVE [ 767.203916] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.204067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.204154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.204373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.204464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.204684] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.204788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.204846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.204997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.205236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.205482] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.205810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.205810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.205918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.205997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.206167] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc0537e1-dba7-4825-8e34-9c03f0cd454d is going to be updated. [ 767.233467] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.233691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.234115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.234115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.234721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.234996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc0537e1-dba7-4825-8e34-9c03f0cd454d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.709320] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.722691] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.722691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.722691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.722978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.722978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.723121] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f already deleted. [ 767.723237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.738240] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dad04559-d224-486f-adbe-3d9a2df06d0a in Status: SUCCESS [ 767.738437] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dad04559-d224-486f-adbe-3d9a2df06d0a deletion is rescheduled due to dependency. [ 767.738843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dad04559-d224-486f-adbe-3d9a2df06d0a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.761590] env[65899]: INFO networking_nsxv3.common.synchronization [req-dce5bf39-2f1e-448e-b505-7e8c27871af9 req-4ef1e44e-1a18-4d6f-b0e3-cd1677ad9577 tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 767.762070] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 767.762469] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.763181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.763181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.763452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.763954] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.764136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.764287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.764522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.764714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.764780] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.212016] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.212524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.212524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.212524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.212636] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.212714] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be created. [ 768.221531] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.221772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.221857] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.222130] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.222523] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.222723] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.222847] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.223083] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.223223] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.223421] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.223525] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.223627] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.223724] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.223822] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.223920] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.224057] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.240073] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.240253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.240332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.240532] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.240698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.244798] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.244992] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.245173] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.245564] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.245668] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.246197] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.246197] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.246519] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.246519] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.251583] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: UNINITIALIZED for 2s [ 768.268430] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.268813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.268813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.269499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.269499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.269499] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.269499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.269499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.269857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.269857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.269857] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 768.299185] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.299344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.299416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.299629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.299767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.310930] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 768.448161] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c25d6485-8f2b-40df-8413-130ac882f781 tempest-MigrationsAdminTest-1684116011 tempest-MigrationsAdminTest-1684116011-project-member] Enqueued Resource ID: 8c847335-ded0-4c2e-9596-5470afcecb82 with Priority: HIGHEST for action security_group_rules [ 768.448601] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c847335-ded0-4c2e-9596-5470afcecb82 with Priority: HIGHEST for action security_group_rules [ 768.448917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c847335-ded0-4c2e-9596-5470afcecb82 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.449136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c847335-ded0-4c2e-9596-5470afcecb82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.449247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c847335-ded0-4c2e-9596-5470afcecb82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.449506] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c847335-ded0-4c2e-9596-5470afcecb82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.449592] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c847335-ded0-4c2e-9596-5470afcecb82',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.644482] env[65899]: INFO networking_nsxv3.common.synchronization [None req-87312b55-1d16-4555-947b-49ce96fc4d27 tempest-MigrationsAdminTest-1684116011 tempest-MigrationsAdminTest-1684116011-project-member] Enqueued Resource ID: 8c847335-ded0-4c2e-9596-5470afcecb82 with Priority: HIGHEST for action security_group_rules [ 768.645118] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c847335-ded0-4c2e-9596-5470afcecb82 with Priority: HIGHEST for action security_group_rules [ 768.645277] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c847335-ded0-4c2e-9596-5470afcecb82 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.645376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c847335-ded0-4c2e-9596-5470afcecb82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.749461] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.749798] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.749959] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.750329] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.750520] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.751455] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70 not found, creating... [ 768.751455] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.751455] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.751455] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.751785] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.751785] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.752034] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.752431] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.752540] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.752744] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.752875] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.753094] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70 is going to be created. [ 768.775483] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.775677] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.775820] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.776120] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.776347] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.776566] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.971211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.971406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.971474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.971695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.971880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.971880] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c847335-ded0-4c2e-9596-5470afcecb82 already deleted. [ 768.972525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c847335-ded0-4c2e-9596-5470afcecb82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.972525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c847335-ded0-4c2e-9596-5470afcecb82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.972525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c847335-ded0-4c2e-9596-5470afcecb82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.972525] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c847335-ded0-4c2e-9596-5470afcecb82',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.495527] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.495855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.495855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.496127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.496127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.496228] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c847335-ded0-4c2e-9596-5470afcecb82 already deleted. [ 769.496264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c847335-ded0-4c2e-9596-5470afcecb82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.501709] env[65899]: INFO networking_nsxv3.common.synchronization [req-dce5bf39-2f1e-448e-b505-7e8c27871af9 req-1195954b-57b3-482c-b069-959e2c0d65ac service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 769.501848] env[65899]: INFO networking_nsxv3.common.synchronization [req-dce5bf39-2f1e-448e-b505-7e8c27871af9 req-1195954b-57b3-482c-b069-959e2c0d65ac service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 769.503957] env[65899]: INFO networking_nsxv3.common.synchronization [req-dce5bf39-2f1e-448e-b505-7e8c27871af9 req-1195954b-57b3-482c-b069-959e2c0d65ac service nova] Enqueued Resource ID: 182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70 with Priority: HIGHEST for action port [ 769.504261] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 769.504261] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 769.504261] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70 with Priority: HIGHEST for action port [ 769.504590] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.504772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.504865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.505128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.505212] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.506344] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.506344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.506571] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.506571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.506571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.506914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.506914] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.677226] env[65899]: INFO networking_nsxv3.common.synchronization [req-fcd8fa92-d24a-4086-88e4-c42d97262543 req-c75e73a9-f917-4085-9a13-cf0b19c0b3ba tempest-SecurityGroupRulesTestJSON-609420685 tempest-SecurityGroupRulesTestJSON-609420685-project-member] Enqueued Resource ID: a0a6e106-8e21-42f0-988d-bba37739fddb with Priority: HIGHEST for action security_group_rules [ 769.677768] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6e106-8e21-42f0-988d-bba37739fddb with Priority: HIGHEST for action security_group_rules [ 769.678376] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a6e106-8e21-42f0-988d-bba37739fddb taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.678502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.678574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.678813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.678912] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a6e106-8e21-42f0-988d-bba37739fddb',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.011517] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.011709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.011890] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70 with status ACTIVE [ 770.012088] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.012196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.012367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.012538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.012662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.012849] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.012978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.013153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.013222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.013287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.013446] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.013559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.013644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.013780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.013780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.013968] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70 is going to be updated. [ 770.043457] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.043457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.043457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.043699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.043833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.043990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-182d0f43-8ab7-4c5f-b6d2-d43d80b7cf70" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.203535] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.205751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.205751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.205751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.205751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.205751] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a6e106-8e21-42f0-988d-bba37739fddb already deleted. [ 770.205751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.269555] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 770.269968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.270179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.270491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.270795] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.270960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.271135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.271205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.271302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.271389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.271482] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.321140] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 770.321140] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 deletion is rescheduled due to dependency. [ 770.321140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.321140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.321140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.321140] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.321592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.321592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.321592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.321592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.321725] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.775281] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.775281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.775281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.775281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.775281] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.775281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.775281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.775281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.775281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.775281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.775900] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.775900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.775900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.775900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.775900] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.775900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.775900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.776531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.776531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.776531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.776531] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.824928] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.279944] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b339ac-01aa-4f28-9e73-9f48477e571d: rpc.has_security_group_logging(os_id): False [ 771.300046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.300046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.300046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.300254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.300398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.300633] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.300722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.300778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.300894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.301017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.301146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.302146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.302146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.302146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.302146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.302146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.302146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.302146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.302146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.302146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.302146] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be created. [ 771.327288] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.362024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.362024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.362024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.362024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.362024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.377082] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 771.831381] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.831381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.831381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.831955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.831955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.831955] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 771.870059] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.870153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.870193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.870403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.870544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.881371] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 772.263305] env[65899]: INFO networking_nsxv3.common.synchronization [req-fc2c27ec-0171-4bdb-a5fd-c2f323c18d0b req-719a9585-656a-42fb-9f21-123ffbb0a179 tempest-ImagesOneServerNegativeTestJSON-1508153592 tempest-ImagesOneServerNegativeTestJSON-1508153592-project-member] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 772.263964] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 772.264292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.264434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.264492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.264718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.265139] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.265139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.265139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.265367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.265367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.265367] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.769797] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.770167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.770280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.771882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.771882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.771882] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.771882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.771882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.771882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.771882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.771882] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 772.802609] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.802763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.802826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.803041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.803193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.815293] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 773.393257] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 773.394716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.523615] env[65899]: INFO networking_nsxv3.common.synchronization [req-a92ff29d-69fc-40d3-ad14-91d74e43f469 req-f6fc2bee-1d1a-4e14-9416-290420c61d91 tempest-SecurityGroupRulesTestJSON-609420685 tempest-SecurityGroupRulesTestJSON-609420685-project-member] Enqueued Resource ID: a0a6e106-8e21-42f0-988d-bba37739fddb with Priority: HIGHEST for action security_group_rules [ 773.524254] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0a6e106-8e21-42f0-988d-bba37739fddb with Priority: HIGHEST for action security_group_rules [ 773.524768] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0a6e106-8e21-42f0-988d-bba37739fddb taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.524905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.525276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.525931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.526040] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0a6e106-8e21-42f0-988d-bba37739fddb',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.752683] env[65899]: INFO networking_nsxv3.common.synchronization [req-0cca6ae5-168b-4154-b78e-c426c429f701 req-6b0d601b-a060-410d-be18-fa594dbfda54 tempest-DeleteServersAdminTestJSON-1955726497 tempest-DeleteServersAdminTestJSON-1955726497-project-member] Enqueued Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 773.753350] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 with Priority: HIGHEST for action security_group_members [ 773.753759] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6efcb92-8e15-4172-8949-8449dfa15fb3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.753838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.753838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.754610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.754610] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.754727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.754727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.754856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.754950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.755328] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6efcb92-8e15-4172-8949-8449dfa15fb3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.891374] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 773.891593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.891757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.891976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.892187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.892334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.892391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.892551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.892632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.892717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.892804] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.059858] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.061804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.061938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.063209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.063209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.063209] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0a6e106-8e21-42f0-988d-bba37739fddb already deleted. [ 774.063209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0a6e106-8e21-42f0-988d-bba37739fddb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.258727] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.258977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.259115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.259407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.259561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.259807] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.260017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.260131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.260500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.260500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.260609] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 is going to be updated. [ 774.292610] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.292778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.292843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.293089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.293263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.304042] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: IN_PROGRESS for 2s [ 774.395974] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.396269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.396269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.396457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.396636] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.396866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.396866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.396990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.397037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.397119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.397290] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.397507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.397507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.397507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.397706] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.397818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.397854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.398010] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.398064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.398236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.398277] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.742731] env[65899]: INFO networking_nsxv3.common.synchronization [req-640bf6a1-5085-4e5c-a7c9-b647e2d948b3 req-55d0e7d3-c0a0-4df2-8c03-41d9ab78a956 tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 774.742731] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 774.743047] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.743713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.743713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.743713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.743713] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.743713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.744036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.744036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.744036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.744870] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.773497] env[65899]: INFO networking_nsxv3.common.synchronization [req-640bf6a1-5085-4e5c-a7c9-b647e2d948b3 req-55d0e7d3-c0a0-4df2-8c03-41d9ab78a956 tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 774.773960] env[65899]: INFO networking_nsxv3.common.synchronization [req-640bf6a1-5085-4e5c-a7c9-b647e2d948b3 req-55d0e7d3-c0a0-4df2-8c03-41d9ab78a956 tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 774.773960] env[65899]: INFO networking_nsxv3.common.synchronization [req-640bf6a1-5085-4e5c-a7c9-b647e2d948b3 req-55d0e7d3-c0a0-4df2-8c03-41d9ab78a956 tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c with Priority: HIGHEST for action port [ 774.774384] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 774.774522] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 774.774639] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c with Priority: HIGHEST for action port [ 774.774881] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.774999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.775213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.775470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.775583] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.776484] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.776702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.776938] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-653c31a0-7d12-45e4-99a5-2ae0b332606c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.777092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.777182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.777374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.777471] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('653c31a0-7d12-45e4-99a5-2ae0b332606c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.936761] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc14a464-84a2-4f30-88ae-7b0da98e4e95: rpc.has_security_group_logging(os_id): False [ 774.938305] env[65899]: INFO networking_nsxv3.common.synchronization [None req-04cf7ad4-47a7-495d-a2ba-43a4189afb51 None None] Enqueued Resource ID: 87067c70-9d41-4aed-b54a-bbe2027f67c2 with Priority: HIGHEST for action port [ 774.938987] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87067c70-9d41-4aed-b54a-bbe2027f67c2 with Priority: HIGHEST for action port [ 774.939939] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-87067c70-9d41-4aed-b54a-bbe2027f67c2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.940209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87067c70-9d41-4aed-b54a-bbe2027f67c2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.940209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87067c70-9d41-4aed-b54a-bbe2027f67c2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.940484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87067c70-9d41-4aed-b54a-bbe2027f67c2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.940579] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87067c70-9d41-4aed-b54a-bbe2027f67c2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.947771] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 774.947946] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 deletion is rescheduled due to dependency. [ 774.948065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.959367] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.959367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.959367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.959367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.959674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.959713] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.959993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.959993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.960732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.960732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.960732] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.960732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.960732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.964203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.964203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.964203] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.964203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.964203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.964203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.964203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.964203] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 775.038038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.038508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.038508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.039736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.039736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.057677] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 775.247213] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.435141] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.438159] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 653c31a0-7d12-45e4-99a5-2ae0b332606c with status ACTIVE [ 775.438159] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.438159] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.438159] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.438159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.438754] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c is going to be updated. [ 775.444205] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87067c70-9d41-4aed-b54a-bbe2027f67c2 [ 775.444205] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.444205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.444205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.444205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.444205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.444205] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87067c70-9d41-4aed-b54a-bbe2027f67c2 already deleted. [ 775.444205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87067c70-9d41-4aed-b54a-bbe2027f67c2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.470247] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.471806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.471806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.471806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.471806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.471806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.738765] env[65899]: INFO networking_nsxv3.common.synchronization [req-7a714b9c-845e-4f86-9729-46c02c1810c8 req-5d7c4717-174d-4e8b-8305-39bb0566bcdc tempest-FloatingIPsAssociationTestJSON-926218692 tempest-FloatingIPsAssociationTestJSON-926218692-project-member] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 775.740303] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 775.740696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.741753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.741840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.742421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.742597] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.742709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.742766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.742930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.743022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.743120] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.749395] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.221266] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-514 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.221266] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-514" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.221471] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-514" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.221644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-514" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.221917] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.222587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.222587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.222751] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.222840] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.223266] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.223445] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.223564] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.223675] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.223782] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.223880] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.224018] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.246099] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.248048] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.248206] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.248337] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.248503] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-514" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.249187] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-7feb745f-c6a4-413e-b829-5559c8a1f964 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.249187] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-7feb745f-c6a4-413e-b829-5559c8a1f964" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.249187] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-7feb745f-c6a4-413e-b829-5559c8a1f964" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.249421] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-7feb745f-c6a4-413e-b829-5559c8a1f964" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.249705] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7feb745f-c6a4-413e-b829-5559c8a1f964',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.251025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.251149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.251217] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.251393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.251496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.251587] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be updated. [ 776.286464] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.286647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.286728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.287120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.287120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.297717] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: IN_PROGRESS for 2s [ 776.315384] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 in Status: SUCCESS [ 776.315630] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6efcb92-8e15-4172-8949-8449dfa15fb3 deletion is rescheduled due to dependency. [ 776.315751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6efcb92-8e15-4172-8949-8449dfa15fb3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.535249] env[65899]: INFO networking_nsxv3.common.synchronization [req-8ac79a97-af20-4f99-96ca-835f004b0781 req-3a30c987-9077-4db6-9569-ba002b399d10 tempest-ServerExternalEventsTest-1643309741 tempest-ServerExternalEventsTest-1643309741-project-member] Enqueued Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGHEST for action security_group_members [ 776.535706] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGHEST for action security_group_members [ 776.536050] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccb53a98-d213-45f3-8ad2-09830fe9ee60 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.538373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.538373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.538373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.538373] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.538373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.538373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.538373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.538373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.538373] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.728784] env[65899]: INFO networking_nsxv3.common.synchronization [None req-97032e77-1bde-4ed2-bdc0-552d662400c9 None None] Enqueued Resource ID: a2f5282a-9824-4faf-bac5-d99250b61583 with Priority: HIGHEST for action port [ 776.729074] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2f5282a-9824-4faf-bac5-d99250b61583 with Priority: HIGHEST for action port [ 776.729449] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2f5282a-9824-4faf-bac5-d99250b61583 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.729609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2f5282a-9824-4faf-bac5-d99250b61583" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.729718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2f5282a-9824-4faf-bac5-d99250b61583" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.730012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2f5282a-9824-4faf-bac5-d99250b61583" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.730140] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2f5282a-9824-4faf-bac5-d99250b61583',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.751900] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.757457] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.757580] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.757629] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.757897] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.758052] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.758214] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 7feb745f-c6a4-413e-b829-5559c8a1f964 not found, creating... [ 776.758484] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.758637] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.758748] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.759065] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.759158] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.759365] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.759498] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.759606] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.759801] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.759953] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.760077] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 7feb745f-c6a4-413e-b829-5559c8a1f964 is going to be created. [ 776.786664] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.786929] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.786987] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.787265] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.787492] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.787701] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-7feb745f-c6a4-413e-b829-5559c8a1f964" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.860031] env[65899]: INFO networking_nsxv3.common.synchronization [req-7818bcda-1867-4672-8ad5-62f48aeb3572 req-cfb37fb2-7528-4eea-9965-ae006142f093 tempest-FloatingIPsAssociationNegativeTestJSON-1197764129 tempest-FloatingIPsAssociationNegativeTestJSON-1197764129-project-member] Enqueued Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGHEST for action security_group_members [ 776.860031] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGHEST for action security_group_members [ 776.860423] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6607a38e-6205-4531-b5e6-7fd1d3e900ea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.860575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.860643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.860855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.861073] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.861130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.861188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.861339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.861415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.861503] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.042022] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.042022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.042242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.042593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.042690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.042907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.043014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.043078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.043238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.043479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.043479] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 is going to be updated. [ 777.071437] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 777.071642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.081015] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.081202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.081269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.081460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.082500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.093304] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 in Status: IN_PROGRESS for 2s [ 777.232918] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2f5282a-9824-4faf-bac5-d99250b61583 [ 777.232918] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.233126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.233188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.233512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.233569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.235117] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2f5282a-9824-4faf-bac5-d99250b61583 already deleted. [ 777.235117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2f5282a-9824-4faf-bac5-d99250b61583" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.258094] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.258296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.258410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.258952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.258952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.258952] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 is going to be updated. [ 777.293028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.293184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.293238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.293456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.293719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.308060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: IN_PROGRESS for 2s [ 777.364871] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.365038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.365100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.366452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.366674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.366811] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.366916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.366977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.367173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.367254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.367327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea is going to be updated. [ 777.400195] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.400290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.400632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.400632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.400884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.412028] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea in Status: IN_PROGRESS for 2s [ 777.569727] env[65899]: INFO networking_nsxv3.common.synchronization [req-7a714b9c-845e-4f86-9729-46c02c1810c8 req-9fca7e38-50f9-403b-9484-960f93fad514 service nova] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_rules [ 777.569971] env[65899]: INFO networking_nsxv3.common.synchronization [req-7a714b9c-845e-4f86-9729-46c02c1810c8 req-9fca7e38-50f9-403b-9484-960f93fad514 service nova] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 777.569971] env[65899]: INFO networking_nsxv3.common.synchronization [req-7a714b9c-845e-4f86-9729-46c02c1810c8 req-9fca7e38-50f9-403b-9484-960f93fad514 service nova] Enqueued Resource ID: 7feb745f-c6a4-413e-b829-5559c8a1f964 with Priority: HIGHEST for action port [ 777.570172] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_rules [ 777.570298] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 777.570408] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7feb745f-c6a4-413e-b829-5559c8a1f964 with Priority: HIGHEST for action port [ 777.571418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.576973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.576973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.576973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.576973] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.577662] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.577662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.577662] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7feb745f-c6a4-413e-b829-5559c8a1f964 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.577662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7feb745f-c6a4-413e-b829-5559c8a1f964" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.578143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7feb745f-c6a4-413e-b829-5559c8a1f964" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.578143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7feb745f-c6a4-413e-b829-5559c8a1f964" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.578143] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7feb745f-c6a4-413e-b829-5559c8a1f964',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.081972] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.082149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.082340] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7feb745f-c6a4-413e-b829-5559c8a1f964 with status ACTIVE [ 778.082550] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.082667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.082767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.083057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.083168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.083381] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.083541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.083601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.083844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.083982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.084201] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.084319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.084404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.084603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.087426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.087569] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7feb745f-c6a4-413e-b829-5559c8a1f964 is going to be updated. [ 778.111809] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.111932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.112506] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.112506] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.112896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.113160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7feb745f-c6a4-413e-b829-5559c8a1f964" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.307805] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 778.308031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.308283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.308573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.308768] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.308881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.308938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.309115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.309191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.309289] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.814027] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.104325] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 in Status: SUCCESS [ 779.104462] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 deletion is rescheduled due to dependency. [ 779.104588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.316430] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.319303] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: SUCCESS [ 779.319673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.319673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.319852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.320045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.320395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.320395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.320395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.320536] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.320574] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.421358] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea in Status: SUCCESS [ 779.421358] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea deletion is rescheduled due to dependency. [ 779.421358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.712642] env[65899]: INFO networking_nsxv3.common.synchronization [req-42acda1a-170d-4702-a0ae-d66149b15234 req-b720041b-d96e-44b9-92b9-fcc55f07cd28 tempest-ListServerFiltersTestJSON-273501370 tempest-ListServerFiltersTestJSON-273501370-project-member] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 779.714669] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 779.714669] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.714669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.715233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.715233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.715476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.715476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.715683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.716250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.716250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.717390] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.819675] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.820701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.820701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.820701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.820701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.820701] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be updated. [ 779.823242] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.861052] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.861052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.861246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.861412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.861580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.873020] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: IN_PROGRESS for 2s [ 780.219242] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.219477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.219477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.219723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.219834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.220057] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.220153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.220215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.220463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.220463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.220576] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 already deleted. [ 780.220629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.282579] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.282867] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.283056] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.283541] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.283883] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.284295] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.284438] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.284681] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.284826] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.285044] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.285192] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.285328] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.285462] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.285591] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.285706] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.285874] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.311020] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.311020] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.311020] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.311020] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.311438] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.311529] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.312918] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.312918] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.312918] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.325572] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.815396] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.815633] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.815976] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.816087] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.816252] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.816417] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2 not found, creating... [ 780.816769] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.817013] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.817206] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.817534] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.817744] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.818175] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.818428] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.818636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.818941] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.819129] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.819240] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2 is going to be created. [ 780.828088] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.828408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.828408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.828770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.828770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.828770] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 is going to be updated. [ 780.856483] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.856723] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.856800] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.857095] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.857317] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.857738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.883635] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.884086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.884284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.884587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.884783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.897369] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: IN_PROGRESS for 2s [ 781.486370] env[65899]: INFO networking_nsxv3.common.synchronization [None req-d1e379ca-3c0a-4411-ad8f-355e41cae62c None None] Enqueued Resource ID: 4653a668-4e49-4fbc-8dfe-8c65bc23cc6e with Priority: HIGHEST for action port [ 781.488045] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4653a668-4e49-4fbc-8dfe-8c65bc23cc6e with Priority: HIGHEST for action port [ 781.488045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-4653a668-4e49-4fbc-8dfe-8c65bc23cc6e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.488228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4653a668-4e49-4fbc-8dfe-8c65bc23cc6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.488286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4653a668-4e49-4fbc-8dfe-8c65bc23cc6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.488554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4653a668-4e49-4fbc-8dfe-8c65bc23cc6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.488701] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4653a668-4e49-4fbc-8dfe-8c65bc23cc6e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.552077] env[65899]: INFO networking_nsxv3.common.synchronization [req-42acda1a-170d-4702-a0ae-d66149b15234 req-dc087dde-5e82-4a58-98c1-8a0cac670b61 service nova] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_rules [ 781.552077] env[65899]: INFO networking_nsxv3.common.synchronization [req-42acda1a-170d-4702-a0ae-d66149b15234 req-dc087dde-5e82-4a58-98c1-8a0cac670b61 service nova] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 781.552077] env[65899]: INFO networking_nsxv3.common.synchronization [req-42acda1a-170d-4702-a0ae-d66149b15234 req-dc087dde-5e82-4a58-98c1-8a0cac670b61 service nova] Enqueued Resource ID: 4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2 with Priority: HIGHEST for action port [ 781.552077] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_rules [ 781.552077] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 781.552077] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2 with Priority: HIGHEST for action port [ 781.552077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.552077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.552077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.552773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.552970] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.554427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.555350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.555350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.555350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.555350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.555350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.555350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.555666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.555666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.555666] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.556361] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.558032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.558032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.558032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.558032] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.886842] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 781.886842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.886842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.886842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.886842] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.886842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.886842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.886842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.886842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.886842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.886842] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.991121] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4653a668-4e49-4fbc-8dfe-8c65bc23cc6e [ 781.991547] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.991547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.991547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.991754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.991792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.991882] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4653a668-4e49-4fbc-8dfe-8c65bc23cc6e already deleted. [ 781.991958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4653a668-4e49-4fbc-8dfe-8c65bc23cc6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.059430] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.062745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.062745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.062745] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2 with status ACTIVE [ 782.062745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.062745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.062745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.062745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.062745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.062745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.062745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.062745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.063764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.063764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.063764] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.063927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.064039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.064235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.064339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.064448] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2 is going to be updated. [ 782.085035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.085205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.085205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.085517] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.085780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.085855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aa0fa0e-8f0a-4d88-aae0-74a92c97fbc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.389381] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.567140] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.892887] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdbdafb6-4c78-4b83-b960-c24d6a937e53: rpc.has_security_group_logging(os_id): False [ 782.909476] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: SUCCESS [ 782.909476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.909476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.909476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.909476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.909476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.909476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.909476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.909476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.909476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.909476] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.914675] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.914675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.914675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.914675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.914675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.914675] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.914675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.914675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.914675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.914675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.914675] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be updated. [ 782.973291] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.973535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.973620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.973861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.974025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.993047] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: IN_PROGRESS for 2s [ 783.055772] env[65899]: INFO networking_nsxv3.common.synchronization [None req-e54a58e9-1ca2-4d95-bad4-f20ba07f1928 None None] Enqueued Resource ID: a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e with Priority: HIGHEST for action port [ 783.056519] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e with Priority: HIGHEST for action port [ 783.057016] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.057339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.060116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.060116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.060116] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.072130] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.072535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.072734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.073054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.073263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.073543] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be created. [ 783.118419] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.118419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.118419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.118614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.118614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.130792] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: UNINITIALIZED for 2s [ 783.417280] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.417488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.417589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.417862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.418060] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.418209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.418248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.419430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.419430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.419430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.419430] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.419430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.419430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.419430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.419430] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.419430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.419828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.419828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.419828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.419828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.419952] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.560884] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e [ 783.561350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.561574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.561710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.561962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.562214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.562630] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e already deleted. [ 783.562630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a56f85d2-4d2f-4d4b-a2a5-77e1b31ad37e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.927710] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58bb0b54-538c-449e-bd48-369e68a81947: rpc.has_security_group_logging(os_id): False [ 783.950628] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.950628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.950628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.950628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.950628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.950628] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.950628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.950628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.951164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.951164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.951164] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.951164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.951164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.951389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.951389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.955292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.955801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.955801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.955801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.955801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.955801] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 is going to be updated. [ 784.036617] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.036779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.036901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.037066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.037210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.056455] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: IN_PROGRESS for 2s [ 784.944391] env[65899]: INFO networking_nsxv3.common.synchronization [req-b4f65e6e-3673-4be4-a381-196b8626c846 req-f08c541c-27fb-4c25-9790-ab5b848aa2ec tempest-ServerRescueTestJSON-492744644 tempest-ServerRescueTestJSON-492744644-project-member] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 784.945885] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 784.946309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.946460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.946530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.946758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.946920] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.947033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.947104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.947862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.947987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.948109] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.010677] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 785.010947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.145950] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 785.146193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.146372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.146595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.146835] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.146975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.147049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.147213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.147288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.147367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.147481] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.452291] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.493849] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.493849] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-875" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.493849] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-875" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.493849] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-875" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.494518] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.495982] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.496169] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.496417] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.496556] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.496765] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.496870] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.496972] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.497084] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.497186] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.497283] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.497405] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.517582] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.517582] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.517582] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.517582] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-875" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.517865] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-789d6017-8879-456b-8bec-8b8f03f0251f taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.517952] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-789d6017-8879-456b-8bec-8b8f03f0251f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.518100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-789d6017-8879-456b-8bec-8b8f03f0251f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.518459] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-789d6017-8879-456b-8bec-8b8f03f0251f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.518619] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('789d6017-8879-456b-8bec-8b8f03f0251f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.650920] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.651248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.651331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.651613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.651932] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.651932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.652100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.652152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.652213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.652298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.652490] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.652595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.652651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.652801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.652953] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.653117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.653182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.653318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.653393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.653472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.653560] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.791776] env[65899]: INFO networking_nsxv3.common.synchronization [None req-82a0d29d-c2d1-4f0e-805e-0cb796c1c55b None None] Enqueued Resource ID: b4b902f8-21bf-478d-ac30-4f30abeebb02 with Priority: HIGHEST for action port [ 785.793062] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4b902f8-21bf-478d-ac30-4f30abeebb02 with Priority: HIGHEST for action port [ 785.793062] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4b902f8-21bf-478d-ac30-4f30abeebb02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.793062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4b902f8-21bf-478d-ac30-4f30abeebb02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.793419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4b902f8-21bf-478d-ac30-4f30abeebb02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.793500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4b902f8-21bf-478d-ac30-4f30abeebb02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.793554] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b902f8-21bf-478d-ac30-4f30abeebb02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.956317] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.964370] env[65899]: INFO networking_nsxv3.common.synchronization [None req-53b440ef-8e03-48ec-8ce5-6cf15b0d6bf4 None None] Enqueued Resource ID: a2890a57-6c55-4862-987d-bb58b63afb8b with Priority: HIGHEST for action port [ 785.964370] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2890a57-6c55-4862-987d-bb58b63afb8b with Priority: HIGHEST for action port [ 785.964370] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2890a57-6c55-4862-987d-bb58b63afb8b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.964370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2890a57-6c55-4862-987d-bb58b63afb8b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.964370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2890a57-6c55-4862-987d-bb58b63afb8b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.965848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2890a57-6c55-4862-987d-bb58b63afb8b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.965904] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2890a57-6c55-4862-987d-bb58b63afb8b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.021464] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.022167] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.022536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.023030] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.025018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.025018] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 789d6017-8879-456b-8bec-8b8f03f0251f not found, creating... [ 786.025018] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.025018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.025018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.025018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.025018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.025700] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.026061] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.026306] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.026619] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.026908] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.027196] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 789d6017-8879-456b-8bec-8b8f03f0251f is going to be created. [ 786.050913] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.050913] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.050913] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.050913] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.050913] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.050913] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-789d6017-8879-456b-8bec-8b8f03f0251f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.071079] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: SUCCESS [ 786.071079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.157106] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631: rpc.has_security_group_logging(os_id): False [ 786.190045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.190045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.190045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.190045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.190930] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.190930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.190930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.190930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.190930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.192501] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be created. [ 786.294037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.294037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.294037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.294037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.294037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.295529] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4b902f8-21bf-478d-ac30-4f30abeebb02 [ 786.295741] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.295930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.295930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.296126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.296205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.296295] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4b902f8-21bf-478d-ac30-4f30abeebb02 already deleted. [ 786.296373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4b902f8-21bf-478d-ac30-4f30abeebb02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.306491] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 786.414260] env[65899]: INFO networking_nsxv3.common.synchronization [req-0b9e34d8-bf50-4395-bf08-983e56bd65c6 req-8c789d3a-64f1-46d4-a761-009f2086440d tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 786.416347] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 786.416713] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.416849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.416914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.417588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.417792] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.417909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.417966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.418163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.418251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.418340] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.436581] env[65899]: INFO networking_nsxv3.common.synchronization [req-0b9e34d8-bf50-4395-bf08-983e56bd65c6 req-8c789d3a-64f1-46d4-a761-009f2086440d tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 786.436786] env[65899]: INFO networking_nsxv3.common.synchronization [req-0b9e34d8-bf50-4395-bf08-983e56bd65c6 req-8c789d3a-64f1-46d4-a761-009f2086440d tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 786.436870] env[65899]: INFO networking_nsxv3.common.synchronization [req-0b9e34d8-bf50-4395-bf08-983e56bd65c6 req-8c789d3a-64f1-46d4-a761-009f2086440d tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c with Priority: HIGHEST for action port [ 786.437612] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_rules [ 786.437787] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 786.437915] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c with Priority: HIGHEST for action port [ 786.438343] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.438618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.438682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.438896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.438975] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.440726] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.440861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.441090] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-653c31a0-7d12-45e4-99a5-2ae0b332606c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.441200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.441260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.441523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.441619] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('653c31a0-7d12-45e4-99a5-2ae0b332606c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.458895] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.459152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.459152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.459807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.459910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.459992] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea93861-5728-4289-9609-763ed4d27c02 is going to be updated. [ 786.469749] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2890a57-6c55-4862-987d-bb58b63afb8b [ 786.469999] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.470239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.470239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.470481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.470481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.470573] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2890a57-6c55-4862-987d-bb58b63afb8b already deleted. [ 786.470655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2890a57-6c55-4862-987d-bb58b63afb8b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.514495] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.514659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.514810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.515581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.516558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.529509] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: IN_PROGRESS for 2s [ 786.835115] env[65899]: INFO networking_nsxv3.common.synchronization [req-b4f65e6e-3673-4be4-a381-196b8626c846 req-3b6f45d0-324d-4b90-ba94-cdbbfc0bef8d service nova] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_rules [ 786.835693] env[65899]: INFO networking_nsxv3.common.synchronization [req-b4f65e6e-3673-4be4-a381-196b8626c846 req-3b6f45d0-324d-4b90-ba94-cdbbfc0bef8d service nova] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 786.835693] env[65899]: INFO networking_nsxv3.common.synchronization [req-b4f65e6e-3673-4be4-a381-196b8626c846 req-3b6f45d0-324d-4b90-ba94-cdbbfc0bef8d service nova] Enqueued Resource ID: 789d6017-8879-456b-8bec-8b8f03f0251f with Priority: HIGHEST for action port [ 786.836366] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_rules [ 786.836522] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 786.837275] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789d6017-8879-456b-8bec-8b8f03f0251f with Priority: HIGHEST for action port [ 786.837595] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.837788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.837788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.837977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.838068] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.841991] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.841991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.841991] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-789d6017-8879-456b-8bec-8b8f03f0251f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.841991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-789d6017-8879-456b-8bec-8b8f03f0251f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.841991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-789d6017-8879-456b-8bec-8b8f03f0251f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.841991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-789d6017-8879-456b-8bec-8b8f03f0251f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.841991] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('789d6017-8879-456b-8bec-8b8f03f0251f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.921138] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.945542] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.945681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.945817] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 653c31a0-7d12-45e4-99a5-2ae0b332606c with status ACTIVE [ 786.945980] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.946228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.946228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.947023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.948789] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.948789] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.948789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.948789] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 653c31a0-7d12-45e4-99a5-2ae0b332606c is going to be updated. [ 786.950772] env[65899]: INFO networking_nsxv3.common.synchronization [req-15e05075-dd0b-4e1e-979e-7d6fd4fb332d req-b2495a97-6505-4ee5-80a8-daac0feaa50e tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 786.951512] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 786.952208] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.952330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.952397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.952684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.952937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.953010] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.953051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.953165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.953536] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.953536] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.973839] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.973839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.973839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.974269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.974269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.974341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-653c31a0-7d12-45e4-99a5-2ae0b332606c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.340092] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.340235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.344344] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 789d6017-8879-456b-8bec-8b8f03f0251f with status ACTIVE [ 787.344703] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.344818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.344818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.345460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.345460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.345460] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.346207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.346207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.346207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.346207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.346207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.346406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.346406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.346487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.346525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.347303] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 789d6017-8879-456b-8bec-8b8f03f0251f is going to be updated. [ 787.354399] env[65899]: INFO networking_nsxv3.common.synchronization [None req-abbb6a7a-31b9-41fa-854d-916f22df6496 tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 787.355663] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 787.356543] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.357181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.357303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.357692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.357808] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.374332] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.374628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.374878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.375432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.375432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.375432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-789d6017-8879-456b-8bec-8b8f03f0251f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.424448] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.455562] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.455954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.456110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.456381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.456479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.456724] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.456856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.456916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.457141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.457227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.457276] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 787.490267] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.490525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.490594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.490917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.493850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.517785] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 787.527745] env[65899]: INFO networking_nsxv3.common.synchronization [None req-8303751a-81cc-473a-bfef-162258aed9ce tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 787.528900] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 787.529080] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.529216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.758067] env[65899]: INFO networking_nsxv3.common.synchronization [req-08cf841a-b594-4c30-b954-298923d2a9e3 req-60b99e45-3ae8-42c6-849d-70d36c9e5c41 tempest-AttachVolumeShelveTestJSON-1192841755 tempest-AttachVolumeShelveTestJSON-1192841755-project-member] Enqueued Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_members [ 787.758838] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_members [ 787.759220] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.759752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.759856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.760454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.760898] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.764018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.764018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.764018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.764018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.764018] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.885974] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.886197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.886197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.886428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.886518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.886637] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a already deleted. [ 787.886732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.886950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.887180] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.887270] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.928778] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.929160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.929363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.930698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.930802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.930900] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be updated. [ 787.966911] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.967318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.967318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.967539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.967760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.979300] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: IN_PROGRESS for 2s [ 788.270563] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.270661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.270704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.270912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.271210] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.271344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.271388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.271518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.271666] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f already deleted. [ 788.272624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.320729] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 788.320729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.323977] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.323977] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.323977] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.323977] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.323977] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.323977] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.323977] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.323977] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.324454] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.324454] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.324454] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.324454] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.324583] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.324729] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.324871] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.325013] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.343125] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.343298] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.343448] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.343596] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.343903] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-bda76f95-db13-4c1e-b09f-44486bb22dea taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.344082] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.344197] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.344511] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.344643] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda76f95-db13-4c1e-b09f-44486bb22dea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.410257] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.410579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.410667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.411164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.411164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.411164] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a already deleted. [ 788.411390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.539857] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: SUCCESS [ 788.540079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.540277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.540522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.540739] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.540854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.541141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.541141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.541226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.541314] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.574719] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9d595585-cd43-4c97-bd99-2a4044f28784 None None] Enqueued Resource ID: 1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853 with Priority: HIGHEST for action port [ 788.574719] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853 with Priority: HIGHEST for action port [ 788.576804] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.576804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.576804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.576804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.577055] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.847364] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.847594] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.847715] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.848107] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.848176] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.848273] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port bda76f95-db13-4c1e-b09f-44486bb22dea not found, creating... [ 788.848524] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.848666] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.848769] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.848969] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.849534] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.849534] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.849534] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.849782] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.849838] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.849946] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.850087] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: bda76f95-db13-4c1e-b09f-44486bb22dea is going to be created. [ 788.883266] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.883266] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.883266] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.883266] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.883266] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.883266] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.044175] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.079403] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853 [ 789.079727] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.079939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.080047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.080668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.080668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.080668] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853 already deleted. [ 789.080929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e66bc4a-5ca2-416a-acb1-ee0cf6cbd853" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.530398] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 789.531553] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d deletion is rescheduled due to dependency. [ 789.532148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.547588] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.619793] env[65899]: INFO networking_nsxv3.common.synchronization [req-08cf841a-b594-4c30-b954-298923d2a9e3 req-0e0f28f1-44c2-401b-8e66-3f559275d0ff service nova] Enqueued Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_rules [ 789.620288] env[65899]: INFO networking_nsxv3.common.synchronization [req-08cf841a-b594-4c30-b954-298923d2a9e3 req-0e0f28f1-44c2-401b-8e66-3f559275d0ff service nova] Enqueued Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_members [ 789.620485] env[65899]: INFO networking_nsxv3.common.synchronization [req-08cf841a-b594-4c30-b954-298923d2a9e3 req-0e0f28f1-44c2-401b-8e66-3f559275d0ff service nova] Enqueued Resource ID: bda76f95-db13-4c1e-b09f-44486bb22dea with Priority: HIGHEST for action port [ 789.621173] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_rules [ 789.621359] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_members [ 789.621864] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda76f95-db13-4c1e-b09f-44486bb22dea with Priority: HIGHEST for action port [ 789.622193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.622441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.622618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.622916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.623119] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.625985] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.626959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.627111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.627353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.627612] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.628194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.628194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.628467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.628618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.628763] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.634220] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-bda76f95-db13-4c1e-b09f-44486bb22dea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.634220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.634220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.634220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.634220] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda76f95-db13-4c1e-b09f-44486bb22dea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.992262] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 789.992618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.992855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.993127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.993355] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.993515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.993605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.993841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.993924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.994055] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.051415] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.053045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.053045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.053045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.053045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.053439] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea93861-5728-4289-9609-763ed4d27c02 is going to be updated. [ 790.086327] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.087814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.087814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.087814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.087814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.099817] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: IN_PROGRESS for 2s [ 790.129033] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.129033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.131281] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.138637] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bda76f95-db13-4c1e-b09f-44486bb22dea with status ACTIVE [ 790.138897] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.139049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.139112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.139324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.139409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.139592] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.139692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.139754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.139894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.139968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.140156] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.140245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.140296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.140651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.140781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.140826] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bda76f95-db13-4c1e-b09f-44486bb22dea is going to be updated. [ 790.169031] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.169031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.169031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.169031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.169031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.169031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.496892] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.634039] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.000984] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.140326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.140326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.140326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.140326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.140326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.140326] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f is going to be created. [ 791.149331] env[65899]: INFO networking_nsxv3.common.synchronization [None req-85cee161-d997-41c0-af3d-5a6563e19a3a None None] Enqueued Resource ID: 0d158f19-323b-4831-8e94-462aaeac23ea with Priority: HIGHEST for action port [ 791.150595] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d158f19-323b-4831-8e94-462aaeac23ea with Priority: HIGHEST for action port [ 791.151428] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d158f19-323b-4831-8e94-462aaeac23ea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.152221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d158f19-323b-4831-8e94-462aaeac23ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.152450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d158f19-323b-4831-8e94-462aaeac23ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.153044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d158f19-323b-4831-8e94-462aaeac23ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.154388] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d158f19-323b-4831-8e94-462aaeac23ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.163147] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.163675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.164958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.165419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.165646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.177997] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: UNINITIALIZED for 2s [ 791.321108] env[65899]: INFO networking_nsxv3.common.synchronization [req-4aef441e-8ade-4fae-bfbc-c94136be540d req-4ce9f1a4-da98-4b73-8c1a-2f8e3a5b0c90 tempest-ListImageFiltersTestJSON-940002557 tempest-ListImageFiltersTestJSON-940002557-project-member] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 791.321419] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 791.321745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.321869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.323794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.323794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.323794] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.323794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.323794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.323794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.323794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.323794] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.504968] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.505155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.505219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.505438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.505519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.505612] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be updated. [ 791.540105] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.540255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.540322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.540551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.540738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.556699] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: IN_PROGRESS for 2s [ 791.660023] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d158f19-323b-4831-8e94-462aaeac23ea [ 791.660023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.660023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.660023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.660023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.660023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.660023] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d158f19-323b-4831-8e94-462aaeac23ea already deleted. [ 791.660023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d158f19-323b-4831-8e94-462aaeac23ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.826578] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.826819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.826819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.827648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.827648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.827648] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.827648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.827648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.827648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.827825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.827825] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085ff348-1812-4078-9ad5-3958496f698b already deleted. [ 791.827869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.878855] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.879429] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.881055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.881055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.881055] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.881055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.881055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.881311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.881839] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.881839] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.881839] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.885863] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.885863] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.885863] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.885863] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.885863] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.912973] env[65899]: INFO networking_nsxv3.common.synchronization [req-2a3dc4c9-883c-493b-83aa-441424c1ca59 req-ede06a5c-0e96-4355-bfc6-f5faa9f2e44f tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_members [ 791.913569] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGHEST for action security_group_members [ 791.913887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-78fc9585-54a3-4e16-8c58-5b307977bb8e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.913998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.914371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.914690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.914933] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.915105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.915940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.915940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.915940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.915940] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.924134] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.924134] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 791.924134] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.924134] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.924134] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-ec00a42f-c404-4884-91ca-76d48ba876ea taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.924134] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-ec00a42f-c404-4884-91ca-76d48ba876ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.924134] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-ec00a42f-c404-4884-91ca-76d48ba876ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.924134] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-ec00a42f-c404-4884-91ca-76d48ba876ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.924134] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec00a42f-c404-4884-91ca-76d48ba876ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.029064] env[65899]: INFO networking_nsxv3.common.synchronization [None req-008a0268-c2d7-44a9-a0d7-38f794ccfb5f None None] Enqueued Resource ID: fcacc932-802a-41f3-9a0e-288740fbea59 with Priority: HIGHEST for action port [ 792.029064] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcacc932-802a-41f3-9a0e-288740fbea59 with Priority: HIGHEST for action port [ 792.029064] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcacc932-802a-41f3-9a0e-288740fbea59 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.029064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcacc932-802a-41f3-9a0e-288740fbea59" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.029064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcacc932-802a-41f3-9a0e-288740fbea59" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.029367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcacc932-802a-41f3-9a0e-288740fbea59" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.029529] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcacc932-802a-41f3-9a0e-288740fbea59',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.114225] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: SUCCESS [ 792.114225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.114411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.114621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.114807] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.114926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.114990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.115161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.115259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.115371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.115477] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.417718] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.417996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.418050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.418615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.418615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.418839] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.418968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.419027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.419718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.419718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.419718] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e is going to be updated. [ 792.426541] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.427757] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.427988] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.428279] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.428456] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.428570] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port ec00a42f-c404-4884-91ca-76d48ba876ea not found, creating... [ 792.428840] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.429010] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.429134] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.429335] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.429462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.429745] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.429889] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.429998] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.431698] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.431845] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.431986] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: ec00a42f-c404-4884-91ca-76d48ba876ea is going to be created. [ 792.452023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.452023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.452023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.452023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.452023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.453155] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.453563] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.453783] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.454120] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.454437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.454736] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-ec00a42f-c404-4884-91ca-76d48ba876ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.461574] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e in Status: IN_PROGRESS for 2s [ 792.532290] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fcacc932-802a-41f3-9a0e-288740fbea59 [ 792.532793] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.532910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.532910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.536027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.536027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.536027] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fcacc932-802a-41f3-9a0e-288740fbea59 already deleted. [ 792.536027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcacc932-802a-41f3-9a0e-288740fbea59" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.622020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.622020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.622020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.622020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.622020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.622958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.622958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.622958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.622958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.622958] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.130306] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aea93861-5728-4289-9609-763ed4d27c02: rpc.has_security_group_logging(os_id): False [ 793.156385] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.156988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.157190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.158234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.158234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.158234] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.158234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.159380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.160830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.161033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.161272] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.161432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.161523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.161761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.162068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.162119] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.162204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.162273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.162442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.162601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.162714] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea93861-5728-4289-9609-763ed4d27c02 is going to be updated. [ 793.192583] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: SUCCESS [ 793.192583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.192583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.192583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.193110] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.193110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.193110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.193268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.193407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.193503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.193634] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.199202] env[65899]: INFO networking_nsxv3.common.synchronization [req-4aef441e-8ade-4fae-bfbc-c94136be540d req-508a6c6e-42b5-4382-8373-8d88d7bd8868 service nova] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_rules [ 793.199498] env[65899]: INFO networking_nsxv3.common.synchronization [req-4aef441e-8ade-4fae-bfbc-c94136be540d req-508a6c6e-42b5-4382-8373-8d88d7bd8868 service nova] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 793.199819] env[65899]: INFO networking_nsxv3.common.synchronization [req-4aef441e-8ade-4fae-bfbc-c94136be540d req-508a6c6e-42b5-4382-8373-8d88d7bd8868 service nova] Enqueued Resource ID: ec00a42f-c404-4884-91ca-76d48ba876ea with Priority: HIGHEST for action port [ 793.200716] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_rules [ 793.200928] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 793.201271] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec00a42f-c404-4884-91ca-76d48ba876ea with Priority: HIGHEST for action port [ 793.201538] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.201712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.201746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.202096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.202499] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.203522] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.203668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.203724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.204025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.204596] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.204725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.204793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.206770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.206770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.206770] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.206770] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec00a42f-c404-4884-91ca-76d48ba876ea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.206996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec00a42f-c404-4884-91ca-76d48ba876ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.206996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec00a42f-c404-4884-91ca-76d48ba876ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.207241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec00a42f-c404-4884-91ca-76d48ba876ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.207303] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec00a42f-c404-4884-91ca-76d48ba876ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.246680] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.246837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.246908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.247278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.248612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.270343] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: IN_PROGRESS for 2s [ 793.566103] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 793.566418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.566645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.566914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.567292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.567662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.568101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.568255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.568481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.569190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.569190] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.695630] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.701972] env[65899]: INFO networking_nsxv3.common.synchronization [None req-5cd0edcb-50a8-443a-8737-85ac2db2b8cb None None] Enqueued Resource ID: 856aed37-91c3-4774-9197-9120367b574a with Priority: HIGHEST for action port [ 793.702647] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 856aed37-91c3-4774-9197-9120367b574a with Priority: HIGHEST for action port [ 793.702971] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-856aed37-91c3-4774-9197-9120367b574a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.704159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-856aed37-91c3-4774-9197-9120367b574a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.704159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-856aed37-91c3-4774-9197-9120367b574a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.704273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-856aed37-91c3-4774-9197-9120367b574a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.704433] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('856aed37-91c3-4774-9197-9120367b574a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.710311] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.711545] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.711673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.715040] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec00a42f-c404-4884-91ca-76d48ba876ea with status ACTIVE [ 793.715040] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.715040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.715040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.715040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.718067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.718468] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.718659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.718752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.719374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.719374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.719504] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.719630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.719761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.719970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.720123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.721815] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec00a42f-c404-4884-91ca-76d48ba876ea is going to be updated. [ 793.746526] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.746745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.746774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.746978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.747388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.747388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec00a42f-c404-4884-91ca-76d48ba876ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.795168] env[65899]: INFO networking_nsxv3.common.synchronization [req-37811b1d-32f8-426b-9e59-69b18b2d0b43 req-4ad1c46f-bf60-4ffb-bb46-43b3f62078c0 tempest-ListServerFiltersTestJSON-273501370 tempest-ListServerFiltersTestJSON-273501370-project-member] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 793.796349] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 793.799051] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.799051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.799051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.799051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.799051] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.799051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.799051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.799051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.799051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.799051] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.074077] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.198020] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e8e18e2-41de-44dd-a97f-655de1cca16f: rpc.has_security_group_logging(os_id): False [ 794.208946] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 856aed37-91c3-4774-9197-9120367b574a [ 794.209615] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.209615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.209615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.210754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.210754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.210754] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:856aed37-91c3-4774-9197-9120367b574a already deleted. [ 794.210754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-856aed37-91c3-4774-9197-9120367b574a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.213651] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.216681] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.216834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.216931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.217484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.217626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.218025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.218079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.218150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.218347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.218445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.218564] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f is going to be created. [ 794.282059] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.282309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.282381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.282616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.284017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.287310] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.287310] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.287310] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.287543] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.287818] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.287971] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.288091] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.288297] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.288428] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.288681] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.288832] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.288947] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.289800] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.289800] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.289800] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.289800] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.297366] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: IN_PROGRESS for 2s [ 794.302471] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.309119] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.309362] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.309497] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.309668] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.310943] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-19db3f25-b9b4-4af9-9668-043770ee1291 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.310943] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-19db3f25-b9b4-4af9-9668-043770ee1291" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.310943] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-19db3f25-b9b4-4af9-9668-043770ee1291" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.310943] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-19db3f25-b9b4-4af9-9668-043770ee1291" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.310943] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19db3f25-b9b4-4af9-9668-043770ee1291',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.471791] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e in Status: SUCCESS [ 794.471963] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e deletion is rescheduled due to dependency. [ 794.472123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.580194] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdbdafb6-4c78-4b83-b960-c24d6a937e53: rpc.has_security_group_logging(os_id): False [ 794.602230] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.602427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.602540] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.603070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.603070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.603207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.603277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.603321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.603479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.603626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.603673] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be updated. [ 794.670102] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.670465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.670465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.670465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.670646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.689155] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: IN_PROGRESS for 2s [ 794.716218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.716431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.716504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.716756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.716866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.716976] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085ff348-1812-4078-9ad5-3958496f698b is going to be created. [ 794.745801] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.746053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.746212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.746473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.746696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.778977] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: UNINITIALIZED for 2s [ 794.806132] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.813248] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.813248] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.813248] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.813514] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.813724] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.813894] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 19db3f25-b9b4-4af9-9668-043770ee1291 not found, creating... [ 794.814336] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.814500] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.814614] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.814852] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.814999] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.815317] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.815471] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.815582] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.815807] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.815923] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.816089] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 19db3f25-b9b4-4af9-9668-043770ee1291 is going to be created. [ 794.869733] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.869733] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.869733] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.869733] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.870034] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.870703] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-19db3f25-b9b4-4af9-9668-043770ee1291" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285792] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: SUCCESS [ 795.285911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.310085] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.310085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.310085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.310085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.310345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.310345] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 795.345255] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.345418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.345418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.345624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.345777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.358620] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 795.527930] env[65899]: INFO networking_nsxv3.common.synchronization [req-37811b1d-32f8-426b-9e59-69b18b2d0b43 req-feda1d87-39e7-46de-9b1d-315a867ce472 service nova] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_rules [ 795.528161] env[65899]: INFO networking_nsxv3.common.synchronization [req-37811b1d-32f8-426b-9e59-69b18b2d0b43 req-feda1d87-39e7-46de-9b1d-315a867ce472 service nova] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 795.528261] env[65899]: INFO networking_nsxv3.common.synchronization [req-37811b1d-32f8-426b-9e59-69b18b2d0b43 req-feda1d87-39e7-46de-9b1d-315a867ce472 service nova] Enqueued Resource ID: 19db3f25-b9b4-4af9-9668-043770ee1291 with Priority: HIGHEST for action port [ 795.528685] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_rules [ 795.528685] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 795.528685] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19db3f25-b9b4-4af9-9668-043770ee1291 with Priority: HIGHEST for action port [ 795.529271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.529392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.529454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.529652] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.529733] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.530544] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.530655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.530814] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-19db3f25-b9b4-4af9-9668-043770ee1291 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.530902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19db3f25-b9b4-4af9-9668-043770ee1291" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.531086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19db3f25-b9b4-4af9-9668-043770ee1291" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.531145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19db3f25-b9b4-4af9-9668-043770ee1291" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.531189] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19db3f25-b9b4-4af9-9668-043770ee1291',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.035457] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.035833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.035833] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19db3f25-b9b4-4af9-9668-043770ee1291 with status ACTIVE [ 796.036023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.036133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.036224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.036491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.036591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.036771] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.036872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.036942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.037153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.037235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.037477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.037579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.037638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.037780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.037857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.037939] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19db3f25-b9b4-4af9-9668-043770ee1291 is going to be updated. [ 796.060637] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.061119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.061119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.061119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.061243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.061406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19db3f25-b9b4-4af9-9668-043770ee1291" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.312326] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: SUCCESS [ 796.312326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.711541] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 796.711800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.780346] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3ce9f79a-e5a4-467f-996a-9a7d23addcf8 tempest-ServerActionsTestOtherB-1521776614 tempest-ServerActionsTestOtherB-1521776614-project-member] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 796.782228] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 796.786653] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.786653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.786653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.786653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.786653] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.799503] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: SUCCESS [ 796.799503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.799503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.799503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.799503] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.799503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.799503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.799503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.799503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.799503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.799503] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.082484] env[65899]: INFO networking_nsxv3.common.synchronization [None req-5a1d36d5-dd9b-446d-8683-0c308234d422 tempest-ServerActionsTestOtherB-1521776614 tempest-ServerActionsTestOtherB-1521776614-project-member] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 797.082484] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 797.082484] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.082484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.303529] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.303724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.303774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.304043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.304354] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.304354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.304468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.304558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.304671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.304729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.304889] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.304979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.305050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.305189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.305323] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.305413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.305471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.305607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.305680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.305757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.305843] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.308938] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.309138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.309170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.309328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.309450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.309560] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 already deleted. [ 797.309651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.309798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.309943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.310071] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.370983] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 797.371609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.371609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.371761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.371961] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.372117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.372254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.372421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.372593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.372739] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.812200] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 085ff348-1812-4078-9ad5-3958496f698b: rpc.has_security_group_logging(os_id): False [ 797.836101] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.836944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.837111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.838651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.838651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.838651] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 already deleted. [ 797.838651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.838823] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.839448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.839448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.839448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.839448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.839611] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.839611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.839692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.839815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.840265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.840265] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.840265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.840265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.840462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.840496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.840678] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.840790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.840842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.840956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.841055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.841149] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085ff348-1812-4078-9ad5-3958496f698b is going to be created. [ 797.875986] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.917330] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.917554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.917666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.917976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.918271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.940745] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: IN_PROGRESS for 2s [ 798.377813] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.879964] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.880154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.880230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.880418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.880497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.880587] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 798.914087] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.914249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.914308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.914494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.914633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.927254] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 799.142795] env[65899]: INFO networking_nsxv3.common.synchronization [None req-d657b2af-74ff-4824-8c79-b572ff286f96 None None] Enqueued Resource ID: 0b184d59-4b8c-4f52-9686-99b240bfc6ba with Priority: HIGHEST for action port [ 799.142795] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b184d59-4b8c-4f52-9686-99b240bfc6ba with Priority: HIGHEST for action port [ 799.144193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b184d59-4b8c-4f52-9686-99b240bfc6ba taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.144304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b184d59-4b8c-4f52-9686-99b240bfc6ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.144350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b184d59-4b8c-4f52-9686-99b240bfc6ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.144699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b184d59-4b8c-4f52-9686-99b240bfc6ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.144818] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b184d59-4b8c-4f52-9686-99b240bfc6ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.446140] env[65899]: INFO networking_nsxv3.common.synchronization [req-796864ec-65c4-4d24-8237-1022ba365163 req-edd483a5-7634-4058-b5a9-d4bdfa53f962 tempest-ListImageFiltersTestJSON-940002557 tempest-ListImageFiltersTestJSON-940002557-project-member] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 799.446719] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 799.447085] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.448094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.448094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.448094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.448094] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.448094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.448094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.448094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.448371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.448371] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.648996] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b184d59-4b8c-4f52-9686-99b240bfc6ba [ 799.649318] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.649519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.649627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.649902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.650227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.650227] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b184d59-4b8c-4f52-9686-99b240bfc6ba already deleted. [ 799.650333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b184d59-4b8c-4f52-9686-99b240bfc6ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.954091] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.955367] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: SUCCESS [ 799.955923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.382565] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.382787] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.382918] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.383243] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.383503] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.383659] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.383770] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.384523] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.384523] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.384523] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 800.384523] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.384683] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.384683] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.384788] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 800.384878] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.384998] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.406246] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.407339] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 800.409902] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.409902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.409902] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-fe95d267-02ae-4134-bf8b-5681dc83e755 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.409902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-fe95d267-02ae-4134-bf8b-5681dc83e755" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.409902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-fe95d267-02ae-4134-bf8b-5681dc83e755" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.409902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-fe95d267-02ae-4134-bf8b-5681dc83e755" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.409902] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe95d267-02ae-4134-bf8b-5681dc83e755',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.456952] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.563406] env[65899]: INFO networking_nsxv3.common.synchronization [req-4177dddd-8c2e-4501-b0cd-0ff869c00a11 req-9c750e6c-9d97-4de1-8fad-a1f6190e67c1 tempest-AttachInterfacesUnderV243Test-1949205229 tempest-AttachInterfacesUnderV243Test-1949205229-project-member] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 800.563698] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGHEST for action security_group_members [ 800.564091] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.564281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.564385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.564631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.564895] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.565100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.565390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.565390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.565538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.566058] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.915990] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.916164] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.916260] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.916524] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.916663] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.916804] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port fe95d267-02ae-4134-bf8b-5681dc83e755 not found, creating... [ 800.917056] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.917317] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.917317] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.917555] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.918026] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.918079] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.918249] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.918386] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.918647] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.918788] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.918938] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: fe95d267-02ae-4134-bf8b-5681dc83e755 is going to be created. [ 800.937193] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 800.937402] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.937709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.937791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.938017] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.938142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.938206] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.938392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.938435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.938500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.938599] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.946955] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.947342] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.947342] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.947548] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.947794] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.947995] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-fe95d267-02ae-4134-bf8b-5681dc83e755" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.961451] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.961451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.961451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.961451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.961451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.961451] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085ff348-1812-4078-9ad5-3958496f698b is going to be updated. [ 801.007791] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.007791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.007791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.007791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.007791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.021988] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: IN_PROGRESS for 2s [ 801.026489] env[65899]: INFO networking_nsxv3.common.synchronization [None req-5c142174-3944-474e-a54f-0c67bbbb1b33 None None] Enqueued Resource ID: 465f9b1c-130f-493c-93da-01fdad17f06e with Priority: HIGHEST for action port [ 801.026489] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 465f9b1c-130f-493c-93da-01fdad17f06e with Priority: HIGHEST for action port [ 801.026489] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-465f9b1c-130f-493c-93da-01fdad17f06e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.026489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-465f9b1c-130f-493c-93da-01fdad17f06e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.026489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-465f9b1c-130f-493c-93da-01fdad17f06e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.026882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-465f9b1c-130f-493c-93da-01fdad17f06e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.027119] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('465f9b1c-130f-493c-93da-01fdad17f06e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.068236] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.068470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.068470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.068677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.068727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.068998] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.069144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.069293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.069339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.069381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.069592] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be updated. [ 801.100593] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.100593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.100593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.100926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.100926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.109705] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: IN_PROGRESS for 2s [ 801.440799] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.441118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.441118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.441287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.441511] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.441695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.441767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.442808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.442808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.442808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.442808] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.442808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.442808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.442808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.443345] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.443345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.443345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.443345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.443458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.443482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.443591] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.531895] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 465f9b1c-130f-493c-93da-01fdad17f06e [ 801.533030] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.533030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.533030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.533030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.533030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.533418] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:465f9b1c-130f-493c-93da-01fdad17f06e already deleted. [ 801.533418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-465f9b1c-130f-493c-93da-01fdad17f06e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.805055] env[65899]: INFO networking_nsxv3.common.synchronization [req-796864ec-65c4-4d24-8237-1022ba365163 req-77e9c410-910d-4f8f-b61d-73dd2fb5c93f service nova] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_rules [ 801.805055] env[65899]: INFO networking_nsxv3.common.synchronization [req-796864ec-65c4-4d24-8237-1022ba365163 req-77e9c410-910d-4f8f-b61d-73dd2fb5c93f service nova] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 801.805055] env[65899]: INFO networking_nsxv3.common.synchronization [req-796864ec-65c4-4d24-8237-1022ba365163 req-77e9c410-910d-4f8f-b61d-73dd2fb5c93f service nova] Enqueued Resource ID: fe95d267-02ae-4134-bf8b-5681dc83e755 with Priority: HIGHEST for action port [ 801.806376] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_rules [ 801.806513] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 801.806661] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe95d267-02ae-4134-bf8b-5681dc83e755 with Priority: HIGHEST for action port [ 801.806907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.807081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.812751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.812751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.812751] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.812905] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.813429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.813429] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe95d267-02ae-4134-bf8b-5681dc83e755 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.813429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe95d267-02ae-4134-bf8b-5681dc83e755" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.813684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe95d267-02ae-4134-bf8b-5681dc83e755" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.813684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe95d267-02ae-4134-bf8b-5681dc83e755" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.815211] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe95d267-02ae-4134-bf8b-5681dc83e755',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.950237] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631: rpc.has_security_group_logging(os_id): False [ 801.975783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.975783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.975783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.975783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.975783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.975783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.975783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.975783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.976308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.976308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.976308] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.976308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.976414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.976716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.976716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.976832] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.977600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.978018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.978259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.978374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.978490] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 802.050960] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.051738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.051883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.052156] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.056238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.069982] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 802.170240] env[65899]: INFO networking_nsxv3.common.synchronization [req-b1296504-0063-4707-82ec-0903d0f773c8 req-48929fef-f976-444a-accf-ff81c62c6814 tempest-ListServerFiltersTestJSON-273501370 tempest-ListServerFiltersTestJSON-273501370-project-member] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 802.171086] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 802.171348] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.171503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.171579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.172707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.172891] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.173377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.173472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.173645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.173913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.174024] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.315969] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.315969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.315969] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe95d267-02ae-4134-bf8b-5681dc83e755 with status ACTIVE [ 802.315969] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.315969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.315969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.316193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.316263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.316419] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.316515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.316573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.316714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.316788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.317012] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.317059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.317172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.317236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.317321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.317403] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe95d267-02ae-4134-bf8b-5681dc83e755 is going to be updated. [ 802.321827] env[65899]: INFO networking_nsxv3.common.synchronization [None req-94f560db-f8f2-4456-bf25-0a638426f566 None None] Enqueued Resource ID: 373862c2-9257-4a01-bc83-eae574c65b0b with Priority: HIGHEST for action port [ 802.322840] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373862c2-9257-4a01-bc83-eae574c65b0b with Priority: HIGHEST for action port [ 802.323160] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-373862c2-9257-4a01-bc83-eae574c65b0b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.323272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-373862c2-9257-4a01-bc83-eae574c65b0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.323511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-373862c2-9257-4a01-bc83-eae574c65b0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.323794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-373862c2-9257-4a01-bc83-eae574c65b0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.323912] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('373862c2-9257-4a01-bc83-eae574c65b0b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.343723] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.345051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.345051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.345051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.345051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.345325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe95d267-02ae-4134-bf8b-5681dc83e755" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.550833] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-471 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.551106] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.551106] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.551488] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.551580] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.551757] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.551891] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.552131] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.552301] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.552478] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.552587] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.552823] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.552823] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.552926] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.553347] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.553347] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.573291] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.573455] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.573591] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.573772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-471" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.574784] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.574784] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.574784] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.574784] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.575018] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ea99cb6-d9f0-410f-a2b9-aa03b521b930',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.675776] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.828725] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 373862c2-9257-4a01-bc83-eae574c65b0b [ 802.829903] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.829903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.829903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.829903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.829903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.829903] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:373862c2-9257-4a01-bc83-eae574c65b0b already deleted. [ 802.829903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-373862c2-9257-4a01-bc83-eae574c65b0b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.042825] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: SUCCESS [ 803.042825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.042825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.042825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.042825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.042825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.042825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.042825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.042825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.042825] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.078015] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.078303] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.079291] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.079291] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.079291] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.079291] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 9ea99cb6-d9f0-410f-a2b9-aa03b521b930 not found, creating... [ 803.079291] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.079549] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.079549] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.079685] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.079816] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.080358] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.080358] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.080358] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.085622] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.085622] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.085622] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 9ea99cb6-d9f0-410f-a2b9-aa03b521b930 is going to be created. [ 803.110008] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.110142] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.110225] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.110455] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.110725] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.110935] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.122779] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 in Status: SUCCESS [ 803.122920] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 deletion is rescheduled due to dependency. [ 803.123052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.178806] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.504757] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0f81fdb1-7159-45a4-879e-ef94f1a188b9 tempest-ImagesOneServerNegativeTestJSON-1508153592 tempest-ImagesOneServerNegativeTestJSON-1508153592-project-member] Enqueued Resource ID: 08f542c3-3e6b-43aa-8f9a-e03460949868 with Priority: HIGHEST for action security_group_rules [ 803.505345] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f542c3-3e6b-43aa-8f9a-e03460949868 with Priority: HIGHEST for action security_group_rules [ 803.505646] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08f542c3-3e6b-43aa-8f9a-e03460949868 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.507520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08f542c3-3e6b-43aa-8f9a-e03460949868" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.507604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08f542c3-3e6b-43aa-8f9a-e03460949868" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.507847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08f542c3-3e6b-43aa-8f9a-e03460949868" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.507925] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08f542c3-3e6b-43aa-8f9a-e03460949868',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.547755] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.682260] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.682535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.682535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.682719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.682843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.682971] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 803.713785] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.714068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.714068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.714212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.714353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.726564] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 803.859482] env[65899]: INFO networking_nsxv3.common.synchronization [req-b1296504-0063-4707-82ec-0903d0f773c8 req-7463b746-3477-4579-bb4f-7265df92cfdf service nova] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_rules [ 803.859482] env[65899]: INFO networking_nsxv3.common.synchronization [req-b1296504-0063-4707-82ec-0903d0f773c8 req-7463b746-3477-4579-bb4f-7265df92cfdf service nova] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 803.859482] env[65899]: INFO networking_nsxv3.common.synchronization [req-b1296504-0063-4707-82ec-0903d0f773c8 req-7463b746-3477-4579-bb4f-7265df92cfdf service nova] Enqueued Resource ID: 9ea99cb6-d9f0-410f-a2b9-aa03b521b930 with Priority: HIGHEST for action port [ 803.859482] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_rules [ 803.859482] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 803.859812] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ea99cb6-d9f0-410f-a2b9-aa03b521b930 with Priority: HIGHEST for action port [ 803.860364] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.860364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.860916] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.861032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.861229] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.861332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.861397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.861595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.861672] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ea99cb6-d9f0-410f-a2b9-aa03b521b930',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.946703] env[65899]: INFO networking_nsxv3.common.synchronization [None req-8e38502b-c28a-4450-9056-b92a73b00f3d tempest-ImagesOneServerNegativeTestJSON-1508153592 tempest-ImagesOneServerNegativeTestJSON-1508153592-project-member] Enqueued Resource ID: 08f542c3-3e6b-43aa-8f9a-e03460949868 with Priority: HIGHEST for action security_group_rules [ 803.947179] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f542c3-3e6b-43aa-8f9a-e03460949868 with Priority: HIGHEST for action security_group_rules [ 803.947484] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08f542c3-3e6b-43aa-8f9a-e03460949868 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.947586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08f542c3-3e6b-43aa-8f9a-e03460949868" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.032420] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.032613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.032702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.032946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.033065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.033170] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08f542c3-3e6b-43aa-8f9a-e03460949868 already deleted. [ 804.033265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08f542c3-3e6b-43aa-8f9a-e03460949868" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.033436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08f542c3-3e6b-43aa-8f9a-e03460949868" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.033648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08f542c3-3e6b-43aa-8f9a-e03460949868" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.033761] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08f542c3-3e6b-43aa-8f9a-e03460949868',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.051077] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.086012] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 804.086061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.086210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.086441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.086529] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.365699] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ea99cb6-d9f0-410f-a2b9-aa03b521b930 with status ACTIVE [ 804.365699] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.365699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.365699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.365699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.365699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.365984] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.365984] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.365984] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.366117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.366193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.366370] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.366459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.366502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.366646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.366714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.366793] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ea99cb6-d9f0-410f-a2b9-aa03b521b930 is going to be updated. [ 804.388611] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.388876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.388949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.389152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.389282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.389432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ea99cb6-d9f0-410f-a2b9-aa03b521b930" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.553761] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.556287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.556287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.556287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.556287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.556287] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085ff348-1812-4078-9ad5-3958496f698b is going to be updated. [ 804.570026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.570026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.570026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.570242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.570680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.570680] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08f542c3-3e6b-43aa-8f9a-e03460949868 already deleted. [ 804.570680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08f542c3-3e6b-43aa-8f9a-e03460949868" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.590146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.590146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.590146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.590146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.590146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.592478] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.592837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.603219] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: IN_PROGRESS for 2s [ 804.684042] env[65899]: INFO networking_nsxv3.common.synchronization [None req-667a1f95-01f0-48e8-97d3-16fbdaf5f786 None None] Enqueued Resource ID: 019495c3-7815-42a2-a101-f5b849f062e8 with Priority: HIGHEST for action port [ 804.684042] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 019495c3-7815-42a2-a101-f5b849f062e8 with Priority: HIGHEST for action port [ 804.684042] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-019495c3-7815-42a2-a101-f5b849f062e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.685778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-019495c3-7815-42a2-a101-f5b849f062e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.685778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-019495c3-7815-42a2-a101-f5b849f062e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.685778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-019495c3-7815-42a2-a101-f5b849f062e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.685778] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('019495c3-7815-42a2-a101-f5b849f062e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.009058] env[65899]: INFO networking_nsxv3.common.synchronization [None req-f3a30d28-cc22-4483-9692-a0b84c04988b tempest-ServersTestJSON-298606675 tempest-ServersTestJSON-298606675-project-member] Enqueued Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_rules [ 805.009523] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_rules [ 805.009743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.009867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.009922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.010191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.010281] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.172454] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0a652df8-6880-4021-8107-752d9c2f08a1 tempest-ServersTestJSON-298606675 tempest-ServersTestJSON-298606675-project-member] Enqueued Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_rules [ 805.172971] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_rules [ 805.173280] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.173379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.187486] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 019495c3-7815-42a2-a101-f5b849f062e8 [ 805.187703] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.187829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.187893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.188129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.188216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.188308] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:019495c3-7815-42a2-a101-f5b849f062e8 already deleted. [ 805.188387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-019495c3-7815-42a2-a101-f5b849f062e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533915] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.533915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.533915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.533915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533915] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d already deleted. [ 805.533915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.533915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.533915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.533915] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.738256] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 805.738666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.739154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.739594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.739995] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.740769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.740769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.740769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.740769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.740769] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.064060] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.064060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.064060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.064060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.064060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.064060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d already deleted. [ 806.064060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.244386] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.616036] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: SUCCESS [ 806.616036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.616036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.616036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.620035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.620035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.620035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.620035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.620035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.620035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.620035] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.749989] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.124309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.124309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.124309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.124309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.124309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.125345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.125345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.125345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.125345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.125345] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.252886] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.253231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.253369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.253593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.253719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.253887] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 807.288127] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.290034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.290034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.290034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.290034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.301564] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 807.627181] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 085ff348-1812-4078-9ad5-3958496f698b: rpc.has_security_group_logging(os_id): False [ 807.645159] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.645398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.645454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.645653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.645777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.645974] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.646114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.646200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.646436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.646536] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.646746] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.646847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.646907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.647083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.647156] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.647364] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.647455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.647514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.647663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.647813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.647911] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085ff348-1812-4078-9ad5-3958496f698b is going to be updated. [ 807.711793] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.711979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.712073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.712341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.712505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.727617] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: IN_PROGRESS for 2s [ 809.316181] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 809.316181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.316181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.316181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.316181] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.316181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.316181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.316181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.316181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.316181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.316941] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.744759] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: SUCCESS [ 809.744998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.820504] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.820677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.820968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.821171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.821422] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.821728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.821780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.821918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.822010] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.822460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.822897] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.823214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.823247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.823413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.823566] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.823665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.823724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.823890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.823974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.824069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.824161] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.174368] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 810.174458] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 810.328582] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631: rpc.has_security_group_logging(os_id): False [ 810.351068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.351468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.351468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.351578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.351722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.351849] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.351950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.352009] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.352174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.352246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.352996] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.352996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.352996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.352996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.352996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.355208] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.355208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.355208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.355208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.355208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.355208] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 810.417164] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.417425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.417425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.417590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.417733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.439646] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 810.872641] env[65899]: INFO networking_nsxv3.common.synchronization [req-7acf2ae2-dd67-4506-8afe-8b072ee537c5 req-621be8a4-22b5-4a01-9f44-8d5803fe90f7 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 810.873576] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 810.874518] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.874715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.874948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.875346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.875616] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.875782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.875894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.876164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.876301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.876450] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.378859] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.379165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.379165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.379337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.379428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.379635] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.379741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.379798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.379950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.380029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.380116] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b already deleted. [ 811.380195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.748391] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.748598] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.749486] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.750176] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.750942] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.751400] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.754515] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.754515] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.754515] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.754515] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.754515] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.754515] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.754515] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.754515] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.754515] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.754515] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.787495] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.787736] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 811.788502] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.788502] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.788502] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-c233518e-cce1-4deb-a877-199ab32b1c5c taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.788690] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-c233518e-cce1-4deb-a877-199ab32b1c5c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.788690] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-c233518e-cce1-4deb-a877-199ab32b1c5c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.789090] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-c233518e-cce1-4deb-a877-199ab32b1c5c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.789313] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c233518e-cce1-4deb-a877-199ab32b1c5c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.979165] env[65899]: INFO networking_nsxv3.common.synchronization [None req-4503ee39-93c1-4111-9316-2c72e8e8b2bc None None] Enqueued Resource ID: a61f8f6e-9b91-43f5-9c63-c32dcf303f5d with Priority: HIGHEST for action port [ 811.979693] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61f8f6e-9b91-43f5-9c63-c32dcf303f5d with Priority: HIGHEST for action port [ 811.980932] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a61f8f6e-9b91-43f5-9c63-c32dcf303f5d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.980932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a61f8f6e-9b91-43f5-9c63-c32dcf303f5d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.980932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a61f8f6e-9b91-43f5-9c63-c32dcf303f5d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.980932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a61f8f6e-9b91-43f5-9c63-c32dcf303f5d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.980932] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a61f8f6e-9b91-43f5-9c63-c32dcf303f5d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.292016] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.292253] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.292369] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.292659] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.292903] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.292983] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port c233518e-cce1-4deb-a877-199ab32b1c5c not found, creating... [ 812.293265] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.293421] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.293653] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.294228] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.294392] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.294729] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.294942] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.295054] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.295491] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.295491] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.295765] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: c233518e-cce1-4deb-a877-199ab32b1c5c is going to be created. [ 812.319429] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.319616] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.319745] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.320075] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.320388] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.320668] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-c233518e-cce1-4deb-a877-199ab32b1c5c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.470534] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 812.470534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.484607] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a61f8f6e-9b91-43f5-9c63-c32dcf303f5d [ 812.484607] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.484607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.484607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.484607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.484607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.484607] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a61f8f6e-9b91-43f5-9c63-c32dcf303f5d already deleted. [ 812.484607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a61f8f6e-9b91-43f5-9c63-c32dcf303f5d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.051184] env[65899]: INFO networking_nsxv3.common.synchronization [req-7acf2ae2-dd67-4506-8afe-8b072ee537c5 req-15b454f8-4f17-4fd4-a03f-5e290e2b36f6 service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 813.051184] env[65899]: INFO networking_nsxv3.common.synchronization [req-7acf2ae2-dd67-4506-8afe-8b072ee537c5 req-15b454f8-4f17-4fd4-a03f-5e290e2b36f6 service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 813.051184] env[65899]: INFO networking_nsxv3.common.synchronization [req-7acf2ae2-dd67-4506-8afe-8b072ee537c5 req-15b454f8-4f17-4fd4-a03f-5e290e2b36f6 service nova] Enqueued Resource ID: c233518e-cce1-4deb-a877-199ab32b1c5c with Priority: HIGHEST for action port [ 813.051184] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 813.051184] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 813.051184] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c233518e-cce1-4deb-a877-199ab32b1c5c with Priority: HIGHEST for action port [ 813.051780] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.052585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.052585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.052798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.052905] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.057922] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.058076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.058149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.058541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.058541] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.058654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.058654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.058804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.058879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.058973] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.061065] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c233518e-cce1-4deb-a877-199ab32b1c5c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.061192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c233518e-cce1-4deb-a877-199ab32b1c5c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.061232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c233518e-cce1-4deb-a877-199ab32b1c5c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.061400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c233518e-cce1-4deb-a877-199ab32b1c5c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.061468] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c233518e-cce1-4deb-a877-199ab32b1c5c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.280022] env[65899]: INFO networking_nsxv3.common.synchronization [req-be826521-e2cd-4834-b21c-1a9a66ad2c0f req-52003007-6c76-4bee-8395-1312ee16ff51 tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 813.280022] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 813.280022] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.280022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.280022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.280022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.280022] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.280022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.280022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.280022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.280022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.280022] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.565157] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.565157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.565157] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.568898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c233518e-cce1-4deb-a877-199ab32b1c5c with status ACTIVE [ 813.569136] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.569225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.569290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.569481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.570040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.570040] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.570040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.570040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.570233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.570233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.571318] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.571318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.571318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.571318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.571318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.571318] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c233518e-cce1-4deb-a877-199ab32b1c5c is going to be updated. [ 813.595143] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.595375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.595375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.595604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.595900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.595900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c233518e-cce1-4deb-a877-199ab32b1c5c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.785207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.785385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.785460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.785723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.785828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.786070] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.786183] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.786249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.786391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.786466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.786622] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 813.820286] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.821323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.821502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.821886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.822183] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.834042] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 814.072784] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.180174] env[65899]: INFO networking_nsxv3.common.synchronization [req-d3c5b937-3d62-4e88-9106-8bab7b371c6b req-ef2ca89a-1715-4f42-8ca6-0af25314d2af tempest-MigrationsAdminTest-1684116011 tempest-MigrationsAdminTest-1684116011-project-member] Enqueued Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 814.180848] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 814.184635] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.184924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.184924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.186020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.186020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.186020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.186020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.186020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.186020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.186020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.449359] env[65899]: INFO networking_nsxv3.common.synchronization [None req-4f4fd715-24c2-49de-be0c-9397d43ffdcd None None] Enqueued Resource ID: fea23554-c7b2-4d1a-95c9-ca366a4c5448 with Priority: HIGHEST for action port [ 814.452440] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea23554-c7b2-4d1a-95c9-ca366a4c5448 with Priority: HIGHEST for action port [ 814.453401] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fea23554-c7b2-4d1a-95c9-ca366a4c5448 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.453573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fea23554-c7b2-4d1a-95c9-ca366a4c5448" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.453677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fea23554-c7b2-4d1a-95c9-ca366a4c5448" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.454051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fea23554-c7b2-4d1a-95c9-ca366a4c5448" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.454178] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fea23554-c7b2-4d1a-95c9-ca366a4c5448',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.577886] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.578210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.578210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.578433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.578682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.578682] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be created. [ 814.605680] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.605810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.606962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.607299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.607471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.618465] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: UNINITIALIZED for 2s [ 814.689008] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.811106] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.811312] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.811428] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.811711] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.811977] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.812196] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.812321] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.812528] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.812680] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.812929] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.813049] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.813162] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.813265] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.813379] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.813477] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.813616] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.848783] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.848949] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.849093] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.849259] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.849567] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-15b1aead-78f7-4a6d-bafb-7918cf71e560 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.849731] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-15b1aead-78f7-4a6d-bafb-7918cf71e560" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.849875] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-15b1aead-78f7-4a6d-bafb-7918cf71e560" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.850285] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-15b1aead-78f7-4a6d-bafb-7918cf71e560" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.850459] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b1aead-78f7-4a6d-bafb-7918cf71e560',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.957879] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fea23554-c7b2-4d1a-95c9-ca366a4c5448 [ 814.957879] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.957879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.957879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.957879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.958203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.958203] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fea23554-c7b2-4d1a-95c9-ca366a4c5448 already deleted. [ 814.958275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fea23554-c7b2-4d1a-95c9-ca366a4c5448" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.192730] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.354447] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.354660] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.354779] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.355078] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.355218] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.355432] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 15b1aead-78f7-4a6d-bafb-7918cf71e560 not found, creating... [ 815.355610] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.356302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.356302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.356302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.356302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.356479] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.356606] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.356716] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.357111] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.357111] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.357210] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 15b1aead-78f7-4a6d-bafb-7918cf71e560 is going to be created. [ 815.380636] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.380917] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.381073] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.381342] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.381564] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.381773] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-15b1aead-78f7-4a6d-bafb-7918cf71e560" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.455862] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c443fece-71da-4b6a-affc-9fa9b03ce29d None None] Enqueued Resource ID: dd848c2d-7a92-4ea0-8965-66a1d44ffd3f with Priority: HIGHEST for action port [ 815.456410] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd848c2d-7a92-4ea0-8965-66a1d44ffd3f with Priority: HIGHEST for action port [ 815.456706] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd848c2d-7a92-4ea0-8965-66a1d44ffd3f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.456824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd848c2d-7a92-4ea0-8965-66a1d44ffd3f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.456905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd848c2d-7a92-4ea0-8965-66a1d44ffd3f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.457141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd848c2d-7a92-4ea0-8965-66a1d44ffd3f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.457226] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd848c2d-7a92-4ea0-8965-66a1d44ffd3f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.697134] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.697510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.697548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.698090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.698090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.698090] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 is going to be updated. [ 815.731081] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.731081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.731081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.731081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.731081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.740879] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: IN_PROGRESS for 2s [ 815.846804] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 815.848322] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 deletion is rescheduled due to dependency. [ 815.848322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.959407] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd848c2d-7a92-4ea0-8965-66a1d44ffd3f [ 815.959633] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.959760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.959825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.960042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.960126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.960217] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd848c2d-7a92-4ea0-8965-66a1d44ffd3f already deleted. [ 815.960293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd848c2d-7a92-4ea0-8965-66a1d44ffd3f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.120410] env[65899]: INFO networking_nsxv3.common.synchronization [req-d3c5b937-3d62-4e88-9106-8bab7b371c6b req-94ecd55d-3abd-4faf-a9e1-a1fbbffdd4fa service nova] Enqueued Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_rules [ 816.120567] env[65899]: INFO networking_nsxv3.common.synchronization [req-d3c5b937-3d62-4e88-9106-8bab7b371c6b req-94ecd55d-3abd-4faf-a9e1-a1fbbffdd4fa service nova] Enqueued Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 816.120617] env[65899]: INFO networking_nsxv3.common.synchronization [req-d3c5b937-3d62-4e88-9106-8bab7b371c6b req-94ecd55d-3abd-4faf-a9e1-a1fbbffdd4fa service nova] Enqueued Resource ID: 15b1aead-78f7-4a6d-bafb-7918cf71e560 with Priority: HIGHEST for action port [ 816.121874] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_rules [ 816.121874] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 816.121874] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b1aead-78f7-4a6d-bafb-7918cf71e560 with Priority: HIGHEST for action port [ 816.122625] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.122625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.122625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.122625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.122910] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.127215] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.127215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.127215] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-15b1aead-78f7-4a6d-bafb-7918cf71e560 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.127215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15b1aead-78f7-4a6d-bafb-7918cf71e560" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.127215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15b1aead-78f7-4a6d-bafb-7918cf71e560" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.127215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15b1aead-78f7-4a6d-bafb-7918cf71e560" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.127215] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b1aead-78f7-4a6d-bafb-7918cf71e560',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.630599] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.630599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.630599] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15b1aead-78f7-4a6d-bafb-7918cf71e560 with status ACTIVE [ 816.630887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.630946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.631014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.631238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.631330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.631520] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.631611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.631649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.631807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.631916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.632217] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.632300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.632300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.632438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.632541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.632639] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15b1aead-78f7-4a6d-bafb-7918cf71e560 is going to be updated. [ 816.637012] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 816.637605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.637832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.638040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.638950] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.638950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.638950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.638950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.638950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.638950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.639281] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.700525] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.701173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.701173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.701173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.701173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.701403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15b1aead-78f7-4a6d-bafb-7918cf71e560" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.815861] env[65899]: INFO networking_nsxv3.common.synchronization [req-97f2480d-8c4a-4740-b7d4-638a757bb31d req-440fed9d-8067-432e-9932-ac378e588050 tempest-ServerDiagnosticsNegativeTest-1162719504 tempest-ServerDiagnosticsNegativeTest-1162719504-project-member] Enqueued Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGHEST for action security_group_members [ 816.818849] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGHEST for action security_group_members [ 816.819799] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1b07c8-6f18-4d08-b906-df258186de4a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.819948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.820045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.820767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.820767] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.820767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.820767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.820918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.820918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.821049] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.145330] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.145330] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.145330] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.145330] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.145330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.147873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.147873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.147873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.147873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.147873] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.263496] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.263677] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.263809] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.264116] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.264369] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.264612] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.264612] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.264830] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.265019] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.265200] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.265314] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.265416] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.265521] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.265623] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.265718] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.265841] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.293216] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.293430] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.293580] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.293750] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.294100] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-7a13827e-b039-4ffe-bc97-4024a4658a2b taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.294274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-7a13827e-b039-4ffe-bc97-4024a4658a2b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.294413] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-7a13827e-b039-4ffe-bc97-4024a4658a2b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.294729] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-7a13827e-b039-4ffe-bc97-4024a4658a2b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.294860] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a13827e-b039-4ffe-bc97-4024a4658a2b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.323224] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.323406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.323457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.323637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.323729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.323939] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.324052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.324114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.324270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.324357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.324439] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1b07c8-6f18-4d08-b906-df258186de4a already deleted. [ 817.324517] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.461489] env[65899]: INFO networking_nsxv3.common.synchronization [None req-d6293526-d696-4b13-9cf0-cf158b969488 None None] Enqueued Resource ID: b0534be8-6e4a-48db-a9cf-dee0a19e9e50 with Priority: HIGHEST for action port [ 817.462020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0534be8-6e4a-48db-a9cf-dee0a19e9e50 with Priority: HIGHEST for action port [ 817.462409] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0534be8-6e4a-48db-a9cf-dee0a19e9e50 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.462538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0534be8-6e4a-48db-a9cf-dee0a19e9e50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.462607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0534be8-6e4a-48db-a9cf-dee0a19e9e50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.462998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0534be8-6e4a-48db-a9cf-dee0a19e9e50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.462998] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0534be8-6e4a-48db-a9cf-dee0a19e9e50',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.647304] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b: rpc.has_security_group_logging(os_id): False [ 817.666447] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.666603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.666683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.666934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.667053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.667262] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.667364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.667426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.667572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.667646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.667822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.667914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.667970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.668120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.668191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.668371] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.668477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.668507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.668849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.668941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.669037] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be created. [ 817.759285] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.759285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.759285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.759285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.759285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.759285] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: SUCCESS [ 817.759975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.760301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.760507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.760809] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.760956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.761035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.761303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.761388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.761488] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.774122] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 817.801646] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.801646] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.801646] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.801646] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.801646] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.801646] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 7a13827e-b039-4ffe-bc97-4024a4658a2b not found, creating... [ 817.801646] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.801966] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.801966] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.802056] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.803054] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.803473] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.803701] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.803871] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.804166] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.804746] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.804746] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 7a13827e-b039-4ffe-bc97-4024a4658a2b is going to be created. [ 817.834973] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.834973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.834973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.834973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.834973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.835647] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-7a13827e-b039-4ffe-bc97-4024a4658a2b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.882862] env[65899]: INFO networking_nsxv3.common.synchronization [None req-82312a4a-340f-48de-9c3c-f60134cef613 None None] Enqueued Resource ID: e40671a6-f20e-4d61-994b-bba917fd9312 with Priority: HIGHEST for action port [ 817.883465] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40671a6-f20e-4d61-994b-bba917fd9312 with Priority: HIGHEST for action port [ 817.884476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e40671a6-f20e-4d61-994b-bba917fd9312 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.884615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e40671a6-f20e-4d61-994b-bba917fd9312" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.884685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e40671a6-f20e-4d61-994b-bba917fd9312" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.884946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e40671a6-f20e-4d61-994b-bba917fd9312" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.885576] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e40671a6-f20e-4d61-994b-bba917fd9312',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.965159] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0534be8-6e4a-48db-a9cf-dee0a19e9e50 [ 817.965397] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.965825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.965825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.965825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.965938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.966070] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0534be8-6e4a-48db-a9cf-dee0a19e9e50 already deleted. [ 817.966155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0534be8-6e4a-48db-a9cf-dee0a19e9e50" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.264844] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.387380] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e40671a6-f20e-4d61-994b-bba917fd9312 [ 818.387691] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.387831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.387903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.388212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.388311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.388407] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e40671a6-f20e-4d61-994b-bba917fd9312 already deleted. [ 818.388487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e40671a6-f20e-4d61-994b-bba917fd9312" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.607979] env[65899]: INFO networking_nsxv3.common.synchronization [req-97f2480d-8c4a-4740-b7d4-638a757bb31d req-1569ded8-d91e-4428-ac3a-469c964eefec service nova] Enqueued Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGHEST for action security_group_rules [ 818.608209] env[65899]: INFO networking_nsxv3.common.synchronization [req-97f2480d-8c4a-4740-b7d4-638a757bb31d req-1569ded8-d91e-4428-ac3a-469c964eefec service nova] Enqueued Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGHEST for action security_group_members [ 818.608365] env[65899]: INFO networking_nsxv3.common.synchronization [req-97f2480d-8c4a-4740-b7d4-638a757bb31d req-1569ded8-d91e-4428-ac3a-469c964eefec service nova] Enqueued Resource ID: 7a13827e-b039-4ffe-bc97-4024a4658a2b with Priority: HIGHEST for action port [ 818.609088] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGHEST for action security_group_rules [ 818.609581] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGHEST for action security_group_members [ 818.609581] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a13827e-b039-4ffe-bc97-4024a4658a2b with Priority: HIGHEST for action port [ 818.609763] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b1b07c8-6f18-4d08-b906-df258186de4a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.609904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.610042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.610369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.610465] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.611458] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1b07c8-6f18-4d08-b906-df258186de4a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.611583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.611675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.613095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.613095] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.613095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.613095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.613095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.613095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.613095] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.613931] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a13827e-b039-4ffe-bc97-4024a4658a2b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.614112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a13827e-b039-4ffe-bc97-4024a4658a2b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.614112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a13827e-b039-4ffe-bc97-4024a4658a2b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.614739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a13827e-b039-4ffe-bc97-4024a4658a2b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.614739] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a13827e-b039-4ffe-bc97-4024a4658a2b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.768992] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.118025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1b07c8-6f18-4d08-b906-df258186de4a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.118025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.118281] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.119237] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a13827e-b039-4ffe-bc97-4024a4658a2b with status ACTIVE [ 819.119427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.123880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.123880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.124472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.124781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.125159] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.125229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.125258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.125461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.125489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.125701] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.125794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.126166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.128684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.128684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.128684] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a13827e-b039-4ffe-bc97-4024a4658a2b is going to be updated. [ 819.154980] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.155067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.155493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.155493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.155493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.155631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a13827e-b039-4ffe-bc97-4024a4658a2b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.272195] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.272195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.272195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.272195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.272195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.272195] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 is going to be updated. [ 819.315738] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.315956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.316054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.316248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.316396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.329632] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: IN_PROGRESS for 2s [ 819.393455] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cdb4029-2d8d-4820-947b-f54df8336087 req-e753ece3-4b4c-4bc5-be40-e79bc4bbdd6d tempest-MultipleCreateTestJSON-18633285 tempest-MultipleCreateTestJSON-18633285-project-member] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 819.394043] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 819.394908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.395091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.395170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.395537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.396177] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.396527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.396527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.396646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.396689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.396800] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.630153] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.792035] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 819.792318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.901071] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.901260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.901331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.901551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.901642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.901866] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.902666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.902870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.903040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.903133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.903226] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 already deleted. [ 819.903312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.970845] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.971098] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.971311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.971535] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.971794] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.971934] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.973571] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.974048] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.974226] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.974704] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.974704] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.974838] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.974838] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.974931] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.975042] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.975178] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.995412] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.995603] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.995705] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.995864] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.996200] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-44f05285-fa5a-4324-a03d-a7eee2d7902b taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.996367] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-44f05285-fa5a-4324-a03d-a7eee2d7902b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.996478] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-44f05285-fa5a-4324-a03d-a7eee2d7902b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.996882] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-44f05285-fa5a-4324-a03d-a7eee2d7902b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.997036] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f05285-fa5a-4324-a03d-a7eee2d7902b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.131590] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.131846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.131954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.132273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.132413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.132564] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1b07c8-6f18-4d08-b906-df258186de4a is going to be created. [ 820.159179] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.159393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.159393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.159600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.159782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.171239] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1b07c8-6f18-4d08-b906-df258186de4a in Status: UNINITIALIZED for 2s [ 820.336472] env[65899]: INFO networking_nsxv3.common.synchronization [None req-8ca64b0d-5832-449e-8e07-8018da087338 None None] Enqueued Resource ID: 1a40a135-a9d9-4636-8a43-dd9998628310 with Priority: HIGHEST for action port [ 820.336941] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a40a135-a9d9-4636-8a43-dd9998628310 with Priority: HIGHEST for action port [ 820.337418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a40a135-a9d9-4636-8a43-dd9998628310 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.337558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a40a135-a9d9-4636-8a43-dd9998628310" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.337623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a40a135-a9d9-4636-8a43-dd9998628310" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.337879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a40a135-a9d9-4636-8a43-dd9998628310" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.337965] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a40a135-a9d9-4636-8a43-dd9998628310',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.499373] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.499570] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.499730] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.500017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.500158] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.500304] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 44f05285-fa5a-4324-a03d-a7eee2d7902b not found, creating... [ 820.500582] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.500743] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.501065] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.501340] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.501526] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.501860] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.502036] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.502170] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.502406] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.502569] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.502710] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 44f05285-fa5a-4324-a03d-a7eee2d7902b is going to be created. [ 820.524136] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.524422] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.524577] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.525084] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.525269] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.525894] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-44f05285-fa5a-4324-a03d-a7eee2d7902b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.840514] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a40a135-a9d9-4636-8a43-dd9998628310 [ 820.840770] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.840915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.841008] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.841245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.841340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.841440] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a40a135-a9d9-4636-8a43-dd9998628310 already deleted. [ 820.841522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a40a135-a9d9-4636-8a43-dd9998628310" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.281765] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cdb4029-2d8d-4820-947b-f54df8336087 req-b1e7c4be-d24d-48d4-9c15-77e60db3e7a6 service nova] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_rules [ 821.282073] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cdb4029-2d8d-4820-947b-f54df8336087 req-b1e7c4be-d24d-48d4-9c15-77e60db3e7a6 service nova] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 821.282330] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cdb4029-2d8d-4820-947b-f54df8336087 req-b1e7c4be-d24d-48d4-9c15-77e60db3e7a6 service nova] Enqueued Resource ID: 44f05285-fa5a-4324-a03d-a7eee2d7902b with Priority: HIGHEST for action port [ 821.283194] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_rules [ 821.283576] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 821.283576] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f05285-fa5a-4324-a03d-a7eee2d7902b with Priority: HIGHEST for action port [ 821.284047] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.284205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.284296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.284594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.284702] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.290929] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.290929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.290929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.290929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.290929] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.290929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.290929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.290929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.290929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.290929] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.291815] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-44f05285-fa5a-4324-a03d-a7eee2d7902b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.291815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44f05285-fa5a-4324-a03d-a7eee2d7902b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.291815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44f05285-fa5a-4324-a03d-a7eee2d7902b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.291815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44f05285-fa5a-4324-a03d-a7eee2d7902b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.291815] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f05285-fa5a-4324-a03d-a7eee2d7902b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.341756] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: SUCCESS [ 821.341960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.342192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.342299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.342496] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.342616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.342687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.342944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.343091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.343222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.343316] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.488984] env[65899]: INFO networking_nsxv3.common.synchronization [req-8444c259-5c7e-4f15-8265-f6a7b56997fc req-c39da675-bf8e-444e-82e1-e947a374a3b6 tempest-FloatingIPsAssociationTestJSON-926218692 tempest-FloatingIPsAssociationTestJSON-926218692-project-member] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 821.490139] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 821.490139] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.490311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.490311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.490421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.491627] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.491627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.491627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.491627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.491627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.491627] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.708774] env[65899]: INFO networking_nsxv3.common.synchronization [req-5eb9af78-7882-4f16-982f-1ad8981401e8 req-f0dd9d55-edb4-49d2-9a78-d94f28a10159 tempest-ServersAdminNegativeTestJSON-1703860526 tempest-ServersAdminNegativeTestJSON-1703860526-project-member] Enqueued Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 821.709372] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 821.709677] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.709816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.709901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.710446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.710627] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.710737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.710795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.710956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.711067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.711161] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.797867] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.797867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.797867] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.797867] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44f05285-fa5a-4324-a03d-a7eee2d7902b with status ACTIVE [ 821.797867] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.797867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.797867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.798697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.798969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.799374] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.799662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.799943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.800356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.800608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.801087] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.801424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.801648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.802042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.802295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.802557] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44f05285-fa5a-4324-a03d-a7eee2d7902b is going to be updated. [ 821.836288] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.836288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.836288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.836288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.836288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.836288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44f05285-fa5a-4324-a03d-a7eee2d7902b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.846036] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.847031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.847031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.847177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.847579] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.847579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.847579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.847781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.847781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.847869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.848136] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.848341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.848393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.849179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.849179] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.849179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.849179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.849383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.850030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.850030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.850030] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.995958] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.184173] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1b07c8-6f18-4d08-b906-df258186de4a in Status: SUCCESS [ 822.185680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.185680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.185680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.185680] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.185680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.185680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.185680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.185680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.186798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.186798] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.216648] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.305518] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.352886] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9813fef-8c97-4cb6-92ff-4d01107ef382: rpc.has_security_group_logging(os_id): False [ 822.376472] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.376550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.376591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.376797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.376910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.377128] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.377226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.377289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.377455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.377517] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.377695] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.377775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.377835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.377973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.378124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.378309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.378401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.378569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.378620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.378728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.378782] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 is going to be updated. [ 822.450561] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.451041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.451041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.451228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.451280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.466863] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: IN_PROGRESS for 2s [ 822.501399] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.689281] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1b07c8-6f18-4d08-b906-df258186de4a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.689440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.689505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.689714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.689882] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.689981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.690068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.690184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.690268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.690369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.690582] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1b07c8-6f18-4d08-b906-df258186de4a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.690695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.690762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.690903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.691108] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.691205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.691373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.691442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.691520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.691597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.691684] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.718305] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.807722] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.810225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.810225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.810225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.810225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.810225] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be created. [ 822.837310] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.840655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.840655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.840655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.840655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.858800] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: UNINITIALIZED for 2s [ 823.001626] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.001828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.001828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.003018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.003018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.003018] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 is going to be updated. [ 823.039100] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.039100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.039100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.039100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.039100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.045151] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3808f2e4-96eb-4599-9616-9f134bb2bf77 None None] Enqueued Resource ID: 73e891f3-e69a-4183-bda0-87a3ccfc51da with Priority: HIGHEST for action port [ 823.048167] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e891f3-e69a-4183-bda0-87a3ccfc51da with Priority: HIGHEST for action port [ 823.048167] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-73e891f3-e69a-4183-bda0-87a3ccfc51da taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.048167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73e891f3-e69a-4183-bda0-87a3ccfc51da" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.048167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73e891f3-e69a-4183-bda0-87a3ccfc51da" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.048167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73e891f3-e69a-4183-bda0-87a3ccfc51da" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.048167] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73e891f3-e69a-4183-bda0-87a3ccfc51da',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.061737] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: IN_PROGRESS for 2s [ 823.196293] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b1b07c8-6f18-4d08-b906-df258186de4a: rpc.has_security_group_logging(os_id): False [ 823.219021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.219021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.219230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.221651] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.221651] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.221651] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.221651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.222678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.222678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.222678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.222678] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b1b07c8-6f18-4d08-b906-df258186de4a is going to be created. [ 823.223765] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.223943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.224151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.224420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.224420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.224513] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a is going to be updated. [ 823.258147] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.258321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.258355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.258572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.258739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.268532] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: IN_PROGRESS for 2s [ 823.295024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.295602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.295602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.295764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.295992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.313525] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b1b07c8-6f18-4d08-b906-df258186de4a in Status: IN_PROGRESS for 2s [ 823.549104] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73e891f3-e69a-4183-bda0-87a3ccfc51da [ 823.549218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.549330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.549414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.549983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.549983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.549983] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73e891f3-e69a-4183-bda0-87a3ccfc51da already deleted. [ 823.549983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73e891f3-e69a-4183-bda0-87a3ccfc51da" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.486609] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: SUCCESS [ 824.487061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.880853] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 824.881993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.883029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.883029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.883029] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.883029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.883839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.884182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.885674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.887236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.887236] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.077733] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: SUCCESS [ 825.078911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.191431] env[65899]: INFO networking_nsxv3.common.synchronization [req-febf8576-ef03-4d4b-9bd4-51ad51d64190 req-b72687a1-cf76-458c-904c-77bcb6188965 tempest-ServerMetadataNegativeTestJSON-683911506 tempest-ServerMetadataNegativeTestJSON-683911506-project-member] Enqueued Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGHEST for action security_group_members [ 825.192234] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGHEST for action security_group_members [ 825.192746] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ebe8c18-10e1-409f-82d4-0340ed451137 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.192919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.193018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.193401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.193596] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.193784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.193893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.194227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.194355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.194483] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.285129] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: SUCCESS [ 825.285547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.326692] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b1b07c8-6f18-4d08-b906-df258186de4a in Status: SUCCESS [ 825.326951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.389267] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.389487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.389550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.389794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.389961] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.390084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.390143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.390294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.390369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.390578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.390670] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.390670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.390880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.390880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.391239] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.391239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.391239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.391533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.391533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.391533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.391533] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.526323] env[65899]: INFO networking_nsxv3.common.synchronization [None req-90655659-8441-4ffa-bd49-b4dfc9652665 None None] Enqueued Resource ID: 5760db50-a341-4bc2-a4a8-d59dd55de6d0 with Priority: HIGHEST for action port [ 825.526608] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5760db50-a341-4bc2-a4a8-d59dd55de6d0 with Priority: HIGHEST for action port [ 825.527193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5760db50-a341-4bc2-a4a8-d59dd55de6d0 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.527344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5760db50-a341-4bc2-a4a8-d59dd55de6d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.527402] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5760db50-a341-4bc2-a4a8-d59dd55de6d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.527664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5760db50-a341-4bc2-a4a8-d59dd55de6d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.527766] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5760db50-a341-4bc2-a4a8-d59dd55de6d0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.697368] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.698130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.698130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.698303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.698381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.698599] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.698698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.699031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.699031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.699031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.699159] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 is going to be updated. [ 825.731281] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.731281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.731281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.731281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.731560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.741990] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 in Status: IN_PROGRESS for 2s [ 825.895317] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3: rpc.has_security_group_logging(os_id): False [ 825.919820] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.920045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.920045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.920320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.920404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.920668] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.920951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.921334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.921544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.921646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.921882] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.922008] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.922120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.922243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.922313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.922526] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.922631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.922679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.922846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.923029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.923183] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be created. [ 825.992036] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.992231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.992310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.992494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.992704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.007365] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 826.031024] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5760db50-a341-4bc2-a4a8-d59dd55de6d0 [ 826.031306] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.031457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.031530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.031823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.031921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.032032] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5760db50-a341-4bc2-a4a8-d59dd55de6d0 already deleted. [ 826.032113] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5760db50-a341-4bc2-a4a8-d59dd55de6d0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.507492] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ef475c3-efbf-4774-a809-378f72514944 req-1a3f6941-3f35-4e34-87dc-5c173dd0b5d7 tempest-VolumesAssistedSnapshotsTest-2074954003 tempest-VolumesAssistedSnapshotsTest-2074954003-project-member] Enqueued Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_members [ 826.508095] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGHEST for action security_group_members [ 826.508443] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-974c962f-0ed5-4445-b566-b0cc5bb30621 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.508649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.508683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.508891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.511527] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.511527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.511527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.511527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.511527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.511527] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.905537] env[65899]: INFO networking_nsxv3.common.synchronization [None req-31c11273-7397-4ff4-8d98-a8f54421562b tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_rules [ 826.906132] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_rules [ 826.907326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.907505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.908558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.908865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.908865] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.000737] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c8642115-0b02-4956-b45e-3c24e68dbb3b tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_rules [ 827.004977] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_rules [ 827.004977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.004977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.012021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.012167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.012236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.012436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.012520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.012707] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.012803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.012861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.013078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.013137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.013225] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 is going to be updated. [ 827.041926] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.041926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.042144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.042218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.042378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.051881] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 in Status: IN_PROGRESS for 2s [ 827.431038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.431038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.431038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.431038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.431038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.431038] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 already deleted. [ 827.431447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.431884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.432088] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.432179] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.761163] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 in Status: SUCCESS [ 827.761362] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 deletion is rescheduled due to dependency. [ 827.761580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.955145] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.955452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.955452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.955603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.955693] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.955887] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 already deleted. [ 827.955887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.027154] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 828.028943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.065077] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 in Status: SUCCESS [ 829.065400] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 deletion is rescheduled due to dependency. [ 829.065400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.195085] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cdb4029-2d8d-4820-947b-f54df8336087 req-47815857-e03a-4eba-9bbf-c23e31f9b43f tempest-MultipleCreateTestJSON-18633285 tempest-MultipleCreateTestJSON-18633285-project-member] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 829.196972] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 829.198763] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.199069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.199582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.199682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.200213] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.200596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.200596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.200841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.202038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.202038] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.668758] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.669354] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.669354] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.669354] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.669635] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.669774] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.669963] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.670201] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.670341] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.670535] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.670637] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.670738] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.671010] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.671010] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.671103] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.671185] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.691022] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.691022] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.691022] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.691249] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.691534] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-bdefb972-5319-4645-8dae-80f43d8ae252 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.691912] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-bdefb972-5319-4645-8dae-80f43d8ae252" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.691912] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-bdefb972-5319-4645-8dae-80f43d8ae252" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.692314] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-bdefb972-5319-4645-8dae-80f43d8ae252" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.692481] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdefb972-5319-4645-8dae-80f43d8ae252',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.705182] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.194805] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.195115] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.195153] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.195446] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.195675] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.195739] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port bdefb972-5319-4645-8dae-80f43d8ae252 not found, creating... [ 830.195998] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.196168] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.196291] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.196489] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.196618] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.200721] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.200721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.200721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.200721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.200721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.200721] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: bdefb972-5319-4645-8dae-80f43d8ae252 is going to be created. [ 830.207834] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.221116] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.222423] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.222423] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.222423] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.222423] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.222423] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-bdefb972-5319-4645-8dae-80f43d8ae252" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.711536] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.711936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.711936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.712081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.712185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.712288] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 830.744662] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.744885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.744885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.745234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.745487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.759617] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 830.926997] env[65899]: INFO networking_nsxv3.common.synchronization [req-cbd1dec9-13fe-4351-8c07-a83887064355 req-e66482df-8d91-4b2b-8d55-d79c905c07ab tempest-ServerRescueTestJSON-492744644 tempest-ServerRescueTestJSON-492744644-project-member] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 830.927634] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 830.928012] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.928828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.928915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.929151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.929670] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.929670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.929670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.929844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.929844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.929956] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.033248] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cdb4029-2d8d-4820-947b-f54df8336087 req-cfea79fd-93e0-4a6c-ac89-57db13128043 service nova] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_rules [ 831.033583] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cdb4029-2d8d-4820-947b-f54df8336087 req-cfea79fd-93e0-4a6c-ac89-57db13128043 service nova] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 831.033696] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cdb4029-2d8d-4820-947b-f54df8336087 req-cfea79fd-93e0-4a6c-ac89-57db13128043 service nova] Enqueued Resource ID: bdefb972-5319-4645-8dae-80f43d8ae252 with Priority: HIGHEST for action port [ 831.036484] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_rules [ 831.036484] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 831.036484] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdefb972-5319-4645-8dae-80f43d8ae252 with Priority: HIGHEST for action port [ 831.036484] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.036484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.036484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.036484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.036484] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.037327] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.037327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.037327] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdefb972-5319-4645-8dae-80f43d8ae252 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.037327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdefb972-5319-4645-8dae-80f43d8ae252" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.037717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdefb972-5319-4645-8dae-80f43d8ae252" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.037994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdefb972-5319-4645-8dae-80f43d8ae252" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.038130] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdefb972-5319-4645-8dae-80f43d8ae252',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.432629] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.544350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.544618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.544961] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdefb972-5319-4645-8dae-80f43d8ae252 with status ACTIVE [ 831.545497] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.545497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.545684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.546128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.546900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.546900] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.546900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.547155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.547212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.547632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.548448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.548448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.548448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.548448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.548448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.548731] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdefb972-5319-4645-8dae-80f43d8ae252 is going to be updated. [ 831.585165] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.585438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.585438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.585650] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.585796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.585987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdefb972-5319-4645-8dae-80f43d8ae252" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.935234] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.993222] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-0c6b06df-3183-4fc4-a4f5-2a7148eb4056 tempest-ListServersNegativeTestJSON-1875250317 tempest-ListServersNegativeTestJSON-1875250317-project-member] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 831.994107] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 831.994631] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.997033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.997033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.997033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.997033] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.997033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.997033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.997033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.997033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.997033] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.366778] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.366778] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.367056] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.367741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.368071] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.368243] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.368357] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.368587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.368726] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.368978] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.369101] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.369205] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.369307] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.369427] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.369508] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.369633] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.391106] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.392037] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.392037] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.392037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.392333] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-078aa3e2-55ca-4aea-b362-14584618013d taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.392631] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-078aa3e2-55ca-4aea-b362-14584618013d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.392843] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-078aa3e2-55ca-4aea-b362-14584618013d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.393371] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-078aa3e2-55ca-4aea-b362-14584618013d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.393817] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('078aa3e2-55ca-4aea-b362-14584618013d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.438122] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.438455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.438455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.439060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.439060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.439060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea93861-5728-4289-9609-763ed4d27c02 is going to be updated. [ 832.478173] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.478441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.478538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.478830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.479074] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.492113] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: IN_PROGRESS for 2s [ 832.500711] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.501040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.501168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.501489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.501668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.501944] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.502140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.502255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.502469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.502573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.502695] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a already deleted. [ 832.502806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.770396] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 832.770618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.771075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.771140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.771288] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.771501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.771501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.771647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.771728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.772033] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.897637] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.897904] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.898072] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.898384] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.898548] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.898716] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 078aa3e2-55ca-4aea-b362-14584618013d not found, creating... [ 832.898992] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.899232] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.899365] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.899593] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.899728] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.900010] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.900181] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.900292] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.900488] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.900617] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.900758] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 078aa3e2-55ca-4aea-b362-14584618013d is going to be created. [ 832.922239] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.922476] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.922629] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.922855] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.923300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.923540] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-078aa3e2-55ca-4aea-b362-14584618013d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.274616] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.661400] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-13ce6fc5-c6fb-4094-8344-bb716025e7c2 service nova] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_rules [ 833.661645] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-13ce6fc5-c6fb-4094-8344-bb716025e7c2 service nova] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 833.661733] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-13ce6fc5-c6fb-4094-8344-bb716025e7c2 service nova] Enqueued Resource ID: 078aa3e2-55ca-4aea-b362-14584618013d with Priority: HIGHEST for action port [ 833.662236] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_rules [ 833.662372] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 833.662464] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078aa3e2-55ca-4aea-b362-14584618013d with Priority: HIGHEST for action port [ 833.662753] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.662843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.662908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.664729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.664821] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.665794] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.665947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.665947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.666159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.666352] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.666405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.666466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.666622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.666706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.666808] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.667738] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-078aa3e2-55ca-4aea-b362-14584618013d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.667821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-078aa3e2-55ca-4aea-b362-14584618013d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.667864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-078aa3e2-55ca-4aea-b362-14584618013d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.668547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-078aa3e2-55ca-4aea-b362-14584618013d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.668934] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('078aa3e2-55ca-4aea-b362-14584618013d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.780415] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.102682] env[65899]: INFO networking_nsxv3.common.synchronization [req-40f84b64-89b8-4ed2-9300-e83b2f931337 req-90738e46-5b57-473a-89ff-6b8aebb3277c tempest-ServerDiagnosticsNegativeTest-1162719504 tempest-ServerDiagnosticsNegativeTest-1162719504-project-member] Enqueued Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGHEST for action security_group_members [ 834.103273] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGHEST for action security_group_members [ 834.103589] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b1b07c8-6f18-4d08-b906-df258186de4a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.103830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.103878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.104080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.104320] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.104482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.104542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.104708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.104806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.104911] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.175284] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 078aa3e2-55ca-4aea-b362-14584618013d with status ACTIVE [ 834.175565] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.175704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.175775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.176017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.176109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.176293] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.176389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.176449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.176605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.176681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.176857] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.176948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.177018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.177184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.177257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.178772] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 078aa3e2-55ca-4aea-b362-14584618013d is going to be updated. [ 834.180056] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.181063] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.181186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.205838] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.206019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.206099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.206270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.206432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.206557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-078aa3e2-55ca-4aea-b362-14584618013d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.282480] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.282636] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.282708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.282927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.283109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.283164] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 834.354620] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.355155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.355155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.355155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.355382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.367442] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 834.504416] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: SUCCESS [ 834.505233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.607014] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.607269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.607353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.607588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.607683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.607884] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.607983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.608059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.608210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.608286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.608369] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1b07c8-6f18-4d08-b906-df258186de4a is going to be updated. [ 834.642456] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.642612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.642683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.642911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.643659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.654195] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1b07c8-6f18-4d08-b906-df258186de4a in Status: IN_PROGRESS for 2s [ 834.683165] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.189579] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.189579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.189579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.189579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.189579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.189579] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be created. [ 835.213737] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.213737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.213737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.213737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.213737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.225284] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: UNINITIALIZED for 2s [ 836.378705] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 836.378970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.378970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.379128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.379329] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.379475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.379539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.379685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.379854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.379854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.380020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.668685] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b1b07c8-6f18-4d08-b906-df258186de4a in Status: SUCCESS [ 836.668875] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b1b07c8-6f18-4d08-b906-df258186de4a deletion is rescheduled due to dependency. [ 836.669136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.882914] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.883758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.883866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.884228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.884424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.884528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.884588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.884761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.884859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.884958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.885179] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.885320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.885423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.885627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.885781] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.885879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.885940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.886112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.886198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.886275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.886400] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.237286] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 837.238147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.238930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.238930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.238930] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.238930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.239332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.239332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.239332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.239332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.239474] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.249798] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-f7409180-ddc0-46c7-9d01-a1e7fa2a3f9f tempest-ListServersNegativeTestJSON-1875250317 tempest-ListServersNegativeTestJSON-1875250317-project-member] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 837.250393] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 837.250553] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.250684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.250749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.250938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.251647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.251769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.251866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.252132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.252230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.252351] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.389752] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3: rpc.has_security_group_logging(os_id): False [ 837.407782] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.407944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.408040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.408741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.408741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.408741] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.408741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.408741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.409031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.409031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.409273] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.409373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.412977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.412977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.412977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.412977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.412977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.412977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.412977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.412977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.412977] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 837.478272] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.478862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.478862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.478862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.478862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.493191] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 837.741533] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.745045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.754974] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.763942] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.764228] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.764475] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.764808] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.765221] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.765388] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.765533] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.769510] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.769664] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.770031] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.770142] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.770572] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.770572] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.770572] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 837.770760] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.770827] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.806357] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.806604] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 837.806788] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.807014] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.808207] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-d7c15a43-d5d0-42c0-a9db-40d120966c5b taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.808207] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-d7c15a43-d5d0-42c0-a9db-40d120966c5b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.808207] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-d7c15a43-d5d0-42c0-a9db-40d120966c5b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.808464] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-d7c15a43-d5d0-42c0-a9db-40d120966c5b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.808518] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7c15a43-d5d0-42c0-a9db-40d120966c5b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.258880] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.313405] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.313615] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.313735] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.314107] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.314192] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.314354] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port d7c15a43-d5d0-42c0-a9db-40d120966c5b not found, creating... [ 838.314652] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.314846] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.314910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.315170] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.315364] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.315582] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.315727] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.315834] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.316057] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.316240] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.316306] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: d7c15a43-d5d0-42c0-a9db-40d120966c5b is going to be created. [ 838.338664] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.338931] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.339103] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.339322] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.339709] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.339964] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-d7c15a43-d5d0-42c0-a9db-40d120966c5b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.765987] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.765987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.765987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.765987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.765987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.765987] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 838.804122] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.804288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.804324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.804615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.804874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.814678] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 839.093180] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-c2a69097-4527-4667-b8bc-70197ad47cd3 service nova] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_rules [ 839.093180] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-c2a69097-4527-4667-b8bc-70197ad47cd3 service nova] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 839.093180] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-c2a69097-4527-4667-b8bc-70197ad47cd3 service nova] Enqueued Resource ID: d7c15a43-d5d0-42c0-a9db-40d120966c5b with Priority: HIGHEST for action port [ 839.094727] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_rules [ 839.094727] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 839.094727] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c15a43-d5d0-42c0-a9db-40d120966c5b with Priority: HIGHEST for action port [ 839.094727] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.094727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.094727] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.094727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.094727] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7c15a43-d5d0-42c0-a9db-40d120966c5b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.095487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7c15a43-d5d0-42c0-a9db-40d120966c5b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.095487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7c15a43-d5d0-42c0-a9db-40d120966c5b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.095487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7c15a43-d5d0-42c0-a9db-40d120966c5b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.095487] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7c15a43-d5d0-42c0-a9db-40d120966c5b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.512536] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 839.513467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.598070] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7c15a43-d5d0-42c0-a9db-40d120966c5b with status ACTIVE [ 839.598361] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.600978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.600978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.600978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.600978] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7c15a43-d5d0-42c0-a9db-40d120966c5b is going to be updated. [ 839.622762] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.623030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.623030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.623721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.623721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.623721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7c15a43-d5d0-42c0-a9db-40d120966c5b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.143912] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-c35d516d-33ca-480c-a36b-7a859b4be46b tempest-ListServersNegativeTestJSON-1875250317 tempest-ListServersNegativeTestJSON-1875250317-project-member] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 840.143912] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 840.143912] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.143912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.576605] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.576605] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.576605] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.576605] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.576605] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.577169] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.577169] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.577169] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.580744] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.580744] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.580744] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.580744] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.580744] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.580744] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.580744] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.580744] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.604173] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.604173] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.604173] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.604173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-893" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.604173] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-b81b35a4-3666-4dd6-bcee-97256d7b7b56 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.604173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-b81b35a4-3666-4dd6-bcee-97256d7b7b56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.604173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-b81b35a4-3666-4dd6-bcee-97256d7b7b56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.604173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-b81b35a4-3666-4dd6-bcee-97256d7b7b56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.604173] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81b35a4-3666-4dd6-bcee-97256d7b7b56',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.824850] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 840.826503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.826730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.826974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.827214] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.827355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.827459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.827594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.827674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.827757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.827949] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.828058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.828126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.828287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.828430] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.828526] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.828602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.828740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.828824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.828902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.828997] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.829910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.830833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.830833] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.830833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.830833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.830833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.830833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.830833] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.108143] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.108309] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.108432] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.108695] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.108868] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.108962] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port b81b35a4-3666-4dd6-bcee-97256d7b7b56 not found, creating... [ 841.109230] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.109376] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.109484] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.109684] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.109830] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.110077] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.110220] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.110328] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.110522] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.110644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.110769] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: b81b35a4-3666-4dd6-bcee-97256d7b7b56 is going to be created. [ 841.132676] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.132878] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.133144] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.133673] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.133741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.133899] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-b81b35a4-3666-4dd6-bcee-97256d7b7b56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.335531] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbdddd19-b5d8-4409-9731-8dacfc9c1c1a: rpc.has_security_group_logging(os_id): False [ 841.335531] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.366027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.366027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.366027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.366027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.367356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.367356] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.368303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.368303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.368303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.368303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.368646] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be created. [ 841.403886] env[65899]: INFO networking_nsxv3.common.synchronization [None req-a190babd-b152-4a05-af99-c737dc28718a None None] Enqueued Resource ID: 36c34148-46fb-4899-9611-ea55f3b1f6ff with Priority: HIGHEST for action port [ 841.404541] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c34148-46fb-4899-9611-ea55f3b1f6ff with Priority: HIGHEST for action port [ 841.404671] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-36c34148-46fb-4899-9611-ea55f3b1f6ff taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.404745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36c34148-46fb-4899-9611-ea55f3b1f6ff" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.404851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36c34148-46fb-4899-9611-ea55f3b1f6ff" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.405096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36c34148-46fb-4899-9611-ea55f3b1f6ff" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.405180] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36c34148-46fb-4899-9611-ea55f3b1f6ff',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.436188] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.436188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.436188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.436188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.436188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.449848] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 841.837317] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.898475] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-16715dd4-9be8-484a-9dc0-71b4dc5e1d6b service nova] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_rules [ 841.898876] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-16715dd4-9be8-484a-9dc0-71b4dc5e1d6b service nova] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 841.898876] env[65899]: INFO networking_nsxv3.common.synchronization [req-a90e0df5-ab89-46de-b4f6-7836498aec33 req-16715dd4-9be8-484a-9dc0-71b4dc5e1d6b service nova] Enqueued Resource ID: b81b35a4-3666-4dd6-bcee-97256d7b7b56 with Priority: HIGHEST for action port [ 841.899378] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_rules [ 841.899549] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 841.899663] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81b35a4-3666-4dd6-bcee-97256d7b7b56 with Priority: HIGHEST for action port [ 841.899914] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.900067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.900215] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.900297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.900463] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b81b35a4-3666-4dd6-bcee-97256d7b7b56 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.900560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b81b35a4-3666-4dd6-bcee-97256d7b7b56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.900620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b81b35a4-3666-4dd6-bcee-97256d7b7b56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.900819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b81b35a4-3666-4dd6-bcee-97256d7b7b56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.900895] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81b35a4-3666-4dd6-bcee-97256d7b7b56',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.907769] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36c34148-46fb-4899-9611-ea55f3b1f6ff [ 841.907927] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.909483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.909483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.909483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.909483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.909483] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36c34148-46fb-4899-9611-ea55f3b1f6ff already deleted. [ 841.909483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36c34148-46fb-4899-9611-ea55f3b1f6ff" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.297374] env[65899]: INFO networking_nsxv3.common.synchronization [req-ca5cc55d-684e-4ab1-9534-331e9136b36b req-e983d6e7-1cb3-4a14-8fe7-00bdd8eda8fa tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 842.298030] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 842.298288] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.298438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.298582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.298709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.301575] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.301766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.301862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.302069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.302165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.302307] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.340905] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.340905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.340905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.341448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.341448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.341448] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 842.372986] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.373171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.373241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.373588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.373737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.384633] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 842.403913] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b81b35a4-3666-4dd6-bcee-97256d7b7b56 with status ACTIVE [ 842.404477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.404739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.404907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.406117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.406251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.406477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.406670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.406761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.407216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.407345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.408009] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.409114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.409252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.409483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.409662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.409828] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b81b35a4-3666-4dd6-bcee-97256d7b7b56 is going to be updated. [ 842.434684] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.434859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.434893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.435122] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.435297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.435447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b81b35a4-3666-4dd6-bcee-97256d7b7b56" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.809887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.810065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.810140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.810355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.810444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.810629] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.810723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.810785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.810955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.811043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.811150] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 842.842338] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.842515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.842602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.842821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.842985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.870857] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 843.030753] env[65899]: INFO networking_nsxv3.common.synchronization [req-aa612a2b-d10d-468f-a535-789381b675cf req-5dcbd70d-980e-448b-b2bc-fdf2e79c72e9 tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 843.031488] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 843.031825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.031969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.032124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.032416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.032621] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.034807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.034891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.035218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.035491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.035618] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.421800] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.423271] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.423420] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.423820] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.424556] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.424787] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.424946] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.425238] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.425409] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.425648] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.425761] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.425895] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.426033] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.426153] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.426291] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.426450] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.448587] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.448587] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 843.448769] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.448994] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.449432] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.449769] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.450059] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.450422] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.450615] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fbd3868-b3a7-4e8a-96ef-8c2b8459867a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.466482] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 843.467079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.467176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.467478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.467478] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.541069] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.541069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.541069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.541069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.541069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.541069] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.541069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.541069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.541417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.541417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.541417] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a already deleted. [ 843.541544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.704388] env[65899]: INFO networking_nsxv3.common.synchronization [None req-47c2a555-b399-40d9-92b0-a0634a357b34 tempest-AttachVolumeTestJSON-2123047702 tempest-AttachVolumeTestJSON-2123047702-project-member] Enqueued Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_rules [ 843.704560] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_rules [ 843.704934] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.705086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.705162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.705393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.705472] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.953806] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.954141] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.954299] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.954765] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.955014] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.955249] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 6fbd3868-b3a7-4e8a-96ef-8c2b8459867a not found, creating... [ 843.955624] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.955933] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.956121] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.956479] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.956717] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.957161] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.957388] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.957612] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.957928] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.958160] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.958363] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 6fbd3868-b3a7-4e8a-96ef-8c2b8459867a is going to be created. [ 843.970129] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.970310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.982521] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.982748] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.982889] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.983339] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.983609] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.983884] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.093167] env[65899]: INFO networking_nsxv3.common.synchronization [None req-d96d1f6e-8c7e-4207-9dae-51aba66c647e None None] Enqueued Resource ID: a36d8361-2641-4933-b583-9120a6859e82 with Priority: HIGHEST for action port [ 844.093622] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a36d8361-2641-4933-b583-9120a6859e82 with Priority: HIGHEST for action port [ 844.093954] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a36d8361-2641-4933-b583-9120a6859e82 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.094150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a36d8361-2641-4933-b583-9120a6859e82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.094279] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a36d8361-2641-4933-b583-9120a6859e82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.094522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a36d8361-2641-4933-b583-9120a6859e82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.094605] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a36d8361-2641-4933-b583-9120a6859e82',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.100580] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9b0e3135-334c-4291-9d45-5864220a4ca0 tempest-AttachVolumeTestJSON-2123047702 tempest-AttachVolumeTestJSON-2123047702-project-member] Enqueued Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_rules [ 844.101140] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_rules [ 844.101461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.101543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.230095] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.230095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.230095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.230095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.230095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.230095] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 already deleted. [ 844.230095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.230095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.230095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.230095] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.400253] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 844.400253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.400253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.400253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.400253] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.400253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.400253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.400253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.400253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.400253] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.597504] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a36d8361-2641-4933-b583-9120a6859e82 [ 844.598523] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.598523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.598523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.598523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.598523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.598523] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a36d8361-2641-4933-b583-9120a6859e82 already deleted. [ 844.598523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a36d8361-2641-4933-b583-9120a6859e82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.710309] env[65899]: INFO networking_nsxv3.common.synchronization [req-aa612a2b-d10d-468f-a535-789381b675cf req-6003a392-5057-4dce-aed6-477384b2a072 service nova] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 844.710480] env[65899]: INFO networking_nsxv3.common.synchronization [req-aa612a2b-d10d-468f-a535-789381b675cf req-6003a392-5057-4dce-aed6-477384b2a072 service nova] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 844.710605] env[65899]: INFO networking_nsxv3.common.synchronization [req-aa612a2b-d10d-468f-a535-789381b675cf req-6003a392-5057-4dce-aed6-477384b2a072 service nova] Enqueued Resource ID: 6fbd3868-b3a7-4e8a-96ef-8c2b8459867a with Priority: HIGHEST for action port [ 844.711112] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 844.711112] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 844.711112] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fbd3868-b3a7-4e8a-96ef-8c2b8459867a with Priority: HIGHEST for action port [ 844.711691] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.711786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.711845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.712259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.712380] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.713647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.713829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.713916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.714149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.714360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.714630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.714665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.714860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.714939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.715120] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.715877] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.716027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.717492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.717915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.717915] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fbd3868-b3a7-4e8a-96ef-8c2b8459867a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.752902] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.754096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.754096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.754096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.754096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.754096] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 already deleted. [ 844.754096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.880590] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 844.880768] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b deletion is rescheduled due to dependency. [ 844.880879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.901916] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.224020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.224020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.224020] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6fbd3868-b3a7-4e8a-96ef-8c2b8459867a with status ACTIVE [ 845.224020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.224020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.224020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.224740] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.224740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.224740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.224740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.224740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.224740] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6fbd3868-b3a7-4e8a-96ef-8c2b8459867a is going to be updated. [ 845.247409] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.247556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.247625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.247831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.247970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.248147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fbd3868-b3a7-4e8a-96ef-8c2b8459867a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.405327] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.727525] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.742497] env[65899]: INFO networking_nsxv3.common.synchronization [req-8ff08da4-800f-4f8e-95ed-f57c36782497 req-081c0f60-288e-4a03-acfd-37e09374d05a tempest-MultipleCreateTestJSON-18633285 tempest-MultipleCreateTestJSON-18633285-project-member] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 845.743297] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 845.744894] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.745144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.745220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.746337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.746337] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.746337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.746337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.746337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.746337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.746337] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.907746] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.907943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.907976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.908197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.908287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.908381] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 845.940116] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.940779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.940858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.941112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.941306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.952813] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 846.210707] env[65899]: INFO networking_nsxv3.common.synchronization [req-77344f8e-a549-4cf5-827a-bfc784ca9101 req-8c7af632-1470-4928-b9e2-6fa8ac43c6db tempest-ServerActionsTestOtherB-1521776614 tempest-ServerActionsTestOtherB-1521776614-project-member] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 846.211455] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 846.212499] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.212683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.212773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.213085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.213300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.213429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.213498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.213665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.213751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.213845] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.231303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.231303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.231303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.231303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.231303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.231303] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be created. [ 846.251916] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.257383] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.257650] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.257721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.257893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.258161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.269973] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: UNINITIALIZED for 2s [ 846.649328] env[65899]: INFO networking_nsxv3.common.synchronization [None req-efdee53d-a172-49ab-8fcf-c28db58f55a7 None None] Enqueued Resource ID: fe34469b-a9f6-4f16-94d7-6d9f039f5097 with Priority: HIGHEST for action port [ 846.649878] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe34469b-a9f6-4f16-94d7-6d9f039f5097 with Priority: HIGHEST for action port [ 846.653653] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe34469b-a9f6-4f16-94d7-6d9f039f5097 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.654429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe34469b-a9f6-4f16-94d7-6d9f039f5097" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.654429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe34469b-a9f6-4f16-94d7-6d9f039f5097" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.654429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe34469b-a9f6-4f16-94d7-6d9f039f5097" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.654429] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe34469b-a9f6-4f16-94d7-6d9f039f5097',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.716488] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.717029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.717029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.717029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.717029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.717573] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.717573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.717573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.717969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.717969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.718087] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 already deleted. [ 846.718139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.756021] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.033872] env[65899]: INFO networking_nsxv3.common.synchronization [req-23c4ea34-1c2c-4818-af28-638e55513a38 req-2820fce4-14ef-4b4f-ab45-485ffdeb4c5d tempest-MultipleCreateTestJSON-18633285 tempest-MultipleCreateTestJSON-18633285-project-member] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 847.034483] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 847.034837] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.034902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.159871] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe34469b-a9f6-4f16-94d7-6d9f039f5097 [ 847.160113] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.160357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.160357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.163199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.163199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.163199] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe34469b-a9f6-4f16-94d7-6d9f039f5097 already deleted. [ 847.163199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe34469b-a9f6-4f16-94d7-6d9f039f5097" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.261825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.261825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.261825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.261825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.261825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.261825] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 847.290656] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.290782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.290852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.292017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.292017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.306901] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 847.365044] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.365292] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.365292] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.365663] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.366739] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.366739] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.366739] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.366739] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.366739] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.366739] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.367128] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.367128] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.367128] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.367128] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.367297] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.368030] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.387086] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.387259] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 847.387391] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.387579] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.387887] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-f9e96c82-8044-4317-8b5d-a8ef876054f9 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.388058] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-f9e96c82-8044-4317-8b5d-a8ef876054f9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.388171] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-f9e96c82-8044-4317-8b5d-a8ef876054f9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.388555] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-f9e96c82-8044-4317-8b5d-a8ef876054f9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.388640] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9e96c82-8044-4317-8b5d-a8ef876054f9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.891222] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.891788] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.891788] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.891788] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.891927] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.892079] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port f9e96c82-8044-4317-8b5d-a8ef876054f9 not found, creating... [ 847.892355] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.892536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.892745] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.893055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.893055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.893421] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.893600] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.893701] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.893931] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.894483] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.894483] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: f9e96c82-8044-4317-8b5d-a8ef876054f9 is going to be created. [ 847.916442] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.916746] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.916936] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.917313] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.917616] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.918124] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-f9e96c82-8044-4317-8b5d-a8ef876054f9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.965505] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 847.965864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.966174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.966509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.966828] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.967036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.967181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.967447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.967581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.967775] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.286598] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 848.286598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.286598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.286598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.286598] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.286862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.287090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.287401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.287705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.287796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.288309] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.470757] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.689843] env[65899]: INFO networking_nsxv3.common.synchronization [req-77344f8e-a549-4cf5-827a-bfc784ca9101 req-980b786e-642c-44ef-b9f8-a2687aa213c8 service nova] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 848.690033] env[65899]: INFO networking_nsxv3.common.synchronization [req-77344f8e-a549-4cf5-827a-bfc784ca9101 req-980b786e-642c-44ef-b9f8-a2687aa213c8 service nova] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 848.690215] env[65899]: INFO networking_nsxv3.common.synchronization [req-77344f8e-a549-4cf5-827a-bfc784ca9101 req-980b786e-642c-44ef-b9f8-a2687aa213c8 service nova] Enqueued Resource ID: f9e96c82-8044-4317-8b5d-a8ef876054f9 with Priority: HIGHEST for action port [ 848.690920] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 848.691055] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 848.691960] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9e96c82-8044-4317-8b5d-a8ef876054f9 with Priority: HIGHEST for action port [ 848.692278] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.692417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.692540] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.692871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.692871] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.693747] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.693856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.693944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.694860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.694860] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.694860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.694860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.694860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.697703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.697703] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.698110] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9e96c82-8044-4317-8b5d-a8ef876054f9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.698110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9e96c82-8044-4317-8b5d-a8ef876054f9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.698208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9e96c82-8044-4317-8b5d-a8ef876054f9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.698664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9e96c82-8044-4317-8b5d-a8ef876054f9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.698664] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9e96c82-8044-4317-8b5d-a8ef876054f9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.790626] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.973694] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.200945] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.201209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.201269] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.202295] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9e96c82-8044-4317-8b5d-a8ef876054f9 with status ACTIVE [ 849.202384] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.202467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.202561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.202737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.202822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.203057] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.203163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.203306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.203391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.203462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.203789] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.203926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.203996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.204170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.204250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.204365] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9e96c82-8044-4317-8b5d-a8ef876054f9 is going to be updated. [ 849.232231] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.232470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.232470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.232946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.232946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.232946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9e96c82-8044-4317-8b5d-a8ef876054f9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.293493] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80a77268-fa72-46b8-ba25-eed73b0ba36a: rpc.has_security_group_logging(os_id): False [ 849.319430] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 849.319665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.319851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.320161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.320297] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.320422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.320487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.320655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.320739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.320835] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.322562] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.322690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.322760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.322925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.323030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.323329] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.323440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.323504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.323660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.323738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.323824] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be created. [ 849.425987] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.430027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.430027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.430027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.430027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.447090] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 849.480719] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.480719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.480719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.480719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.480719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.480719] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 849.555242] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.555242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.555242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.555242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.555242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.568837] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 849.707697] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.827494] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.827764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.827764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.827968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.828075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.828276] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.828456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.828456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.828593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.829103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.829103] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 849.877997] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.878320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.878437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.878771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.879643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.898302] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 849.901500] env[65899]: INFO networking_nsxv3.common.synchronization [None req-49638cfd-a47b-4451-8902-492724abb9c5 None None] Enqueued Resource ID: cacbe7db-3a6f-49fe-886c-5a3ab0003910 with Priority: HIGHEST for action port [ 849.902241] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacbe7db-3a6f-49fe-886c-5a3ab0003910 with Priority: HIGHEST for action port [ 849.902565] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-cacbe7db-3a6f-49fe-886c-5a3ab0003910 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.902710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cacbe7db-3a6f-49fe-886c-5a3ab0003910" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.902769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cacbe7db-3a6f-49fe-886c-5a3ab0003910" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.903061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cacbe7db-3a6f-49fe-886c-5a3ab0003910" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.903150] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacbe7db-3a6f-49fe-886c-5a3ab0003910',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.209637] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.209917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.209917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.210261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.210399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.210567] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be created. [ 850.240542] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.240698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.240755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.241095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.241415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.251221] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: UNINITIALIZED for 2s [ 850.407901] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cacbe7db-3a6f-49fe-886c-5a3ab0003910 [ 850.408265] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.408373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.408413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.408611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.408703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.408800] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cacbe7db-3a6f-49fe-886c-5a3ab0003910 already deleted. [ 850.408916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cacbe7db-3a6f-49fe-886c-5a3ab0003910" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.397685] env[65899]: INFO networking_nsxv3.common.synchronization [req-ad184f95-aa1b-44a2-8f5f-1d63defb8f8f req-af1d15de-ac78-4d5d-b161-4550d7863e06 tempest-ServersWithSpecificFlavorTestJSON-353865173 tempest-ServersWithSpecificFlavorTestJSON-353865173-project-member] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 851.403409] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 851.403409] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.403409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.403409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.403409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.403409] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.403409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.403409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.403887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.404340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.404340] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.459890] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 851.460507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.586146] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 851.586489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.586722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.586856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.587076] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.587189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.587189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.587519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.587519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.587601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.587700] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.907916] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.907916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.908054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.908780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.908780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.908901] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.908968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.909041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.909199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.909280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.909447] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be updated. [ 851.911017] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 851.911346] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 deletion is rescheduled due to dependency. [ 851.911700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.945490] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.947035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.947035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.947035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.947035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.961431] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: IN_PROGRESS for 2s [ 852.091484] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.091634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.091703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.091920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.092096] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.092202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.092303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.092448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.092514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.092569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.092711] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.092802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.092861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.092996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.093177] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.093239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.093286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.093421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.093498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.093580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.093669] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.263376] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 852.263376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.263376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.263376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.263376] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.263376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.263376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.263376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.263376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.263376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.263718] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.596285] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbdddd19-b5d8-4409-9731-8dacfc9c1c1a: rpc.has_security_group_logging(os_id): False [ 852.612021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.612221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.612283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.612599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.612599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.612836] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.612836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.612927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.613063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.613140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.613390] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.613521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.613558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.613676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.613746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.613921] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.614037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.614109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.614661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.614661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.614661] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 852.676287] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.676287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.676287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.676287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.676287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.689963] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 852.766070] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.268906] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d97c0b7d-58d1-4baf-97be-f3a035518398: rpc.has_security_group_logging(os_id): False [ 853.290687] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.290879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.294417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.294417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.294417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.294417] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.294417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.294417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.294417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.294417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.294417] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be created. [ 853.361458] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.361590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.361656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.361881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.363403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.374206] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 853.972965] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: SUCCESS [ 853.973342] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 deletion is rescheduled due to dependency. [ 853.973489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.710026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 854.710303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.710503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.710730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.710815] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.214612] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.214612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.214612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.215619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.215619] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.215619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.215619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.217259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.217259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.217259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.217259] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.390715] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 855.390715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.678675] env[65899]: INFO networking_nsxv3.common.synchronization [req-6d63e1c3-5c47-4b26-a217-7f3d6b9643ce req-1bec3013-201c-477d-a914-cba1bf97ec78 tempest-FloatingIPsAssociationTestJSON-926218692 tempest-FloatingIPsAssociationTestJSON-926218692-project-member] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 855.679370] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGHEST for action security_group_members [ 855.679772] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.679928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.679998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.680220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.680383] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.680543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.680614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.680790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.680872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.680969] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.719146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.719371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.719466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.719716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.719933] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.720170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.720170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.720359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.720457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.720695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.720740] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.720881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.720941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.721124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.721274] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.721398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.721463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.721775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.721880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.721968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.722140] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.132842] env[65899]: INFO networking_nsxv3.common.synchronization [req-5eff1e3e-857b-43a3-a82a-f163fcdd2865 req-351d12f0-c35f-45d1-b29e-f2e2498463a9 tempest-ListServersNegativeTestJSON-1875250317 tempest-ListServersNegativeTestJSON-1875250317-project-member] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 856.133388] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 856.133698] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.133820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.133876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.134098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.134286] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.134401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.134471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.134757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.134757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.134857] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.141472] env[65899]: INFO networking_nsxv3.common.synchronization [req-2af5e423-7008-494f-ba3c-2519ded7ff07 req-c9677560-179a-4e82-94e2-604a414b8d6c tempest-ServersAdminNegativeTestJSON-1703860526 tempest-ServersAdminNegativeTestJSON-1703860526-project-member] Enqueued Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 856.141867] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa6250d1-4a11-4b07-8308-040a7f86026a with Priority: HIGHEST for action security_group_members [ 856.142172] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa6250d1-4a11-4b07-8308-040a7f86026a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.142776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.142776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.142776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.142776] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.142776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.143045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.143045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.144185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.144185] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa6250d1-4a11-4b07-8308-040a7f86026a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.183460] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.184843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.184843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.184843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.184843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.184843] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.184843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.184843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.184843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.185663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.185663] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 is going to be updated. [ 856.217296] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.217679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.217679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.217752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.217938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.225031] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbdddd19-b5d8-4409-9731-8dacfc9c1c1a: rpc.has_security_group_logging(os_id): False [ 856.227837] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: IN_PROGRESS for 2s [ 856.244364] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.244518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.244589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.244797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.244887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.245092] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.245190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.245252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.245401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.245480] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.245774] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.245871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.245928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.246326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.246326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.246326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.246475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.246475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.246612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.246686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.246768] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 856.321445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.321445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.321445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.321445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.321445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.338621] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 856.613725] env[65899]: INFO networking_nsxv3.common.synchronization [req-0d2ae2c0-9a6f-4510-829a-f6e640808484 req-e9a4a3bd-c617-4341-9f53-beef29f15bb0 tempest-ListServerFiltersTestJSON-273501370 tempest-ListServerFiltersTestJSON-273501370-project-member] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 856.614521] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 856.614628] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.614703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.614837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.615057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.615216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.615324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.615379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.615592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.615683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.615775] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.637152] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.647553] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.647819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.647873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.648129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.648236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.648553] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.648680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.648753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.648943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.649771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.649771] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a is going to be updated. [ 856.692215] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.692401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.692495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.692729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.693143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.704014] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: IN_PROGRESS for 2s [ 856.958061] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ba8068a-b10c-46b7-b145-9960f5debe67 req-6a659585-e45c-4deb-9b1b-e5c17a510976 tempest-InstanceActionsV221TestJSON-192949492 tempest-InstanceActionsV221TestJSON-192949492-project-member] Enqueued Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGHEST for action security_group_members [ 856.958683] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGHEST for action security_group_members [ 856.958957] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-327722f8-ce30-47cb-9d43-141fd71e0315 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.960410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.960523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.961633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.961633] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.961633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.961633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.961633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.961633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.961633] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.117956] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.139024] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.356238] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-335 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.356589] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-335" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.356589] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-335" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.356892] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-335" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.357319] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.357484] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.357622] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.357845] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.358028] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.358196] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.358325] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.358426] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.358535] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.358626] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.358723] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.358850] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.378212] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.378446] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.378556] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.378726] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-335" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.379051] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.379226] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.379338] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.379658] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.379787] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a872c62-fde9-4555-9bc9-2a0f20d8e79c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.463760] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.463953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.464047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.464371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.464465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.464679] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.464778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.464857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.465029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.465111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.465193] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327722f8-ce30-47cb-9d43-141fd71e0315 already deleted. [ 857.465383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.622130] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.643641] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.643641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.643641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.643641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.643641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.643641] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 857.707926] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.707926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.707926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.707926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.707926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.718932] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 857.882158] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.882371] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.882499] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.882806] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.882976] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.883143] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 1a872c62-fde9-4555-9bc9-2a0f20d8e79c not found, creating... [ 857.885025] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.885025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.885025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.885025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.885025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.885025] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.885025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.885025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.885025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.885025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.885489] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 1a872c62-fde9-4555-9bc9-2a0f20d8e79c is going to be created. [ 857.919077] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.919300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.919420] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.919687] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.919909] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.920174] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.124147] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.124326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.124408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.124634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.124773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.124826] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 858.167604] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.167773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.167888] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.168297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.168514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.177822] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 858.236724] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58bb0b54-538c-449e-bd48-369e68a81947 in Status: SUCCESS [ 858.236911] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 deletion is rescheduled due to dependency. [ 858.237041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.355717] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 858.355717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.633180] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ba8068a-b10c-46b7-b145-9960f5debe67 req-1d564ae6-9afb-4a3d-9ffe-5044deaf5472 service nova] Enqueued Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGHEST for action security_group_rules [ 858.633472] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ba8068a-b10c-46b7-b145-9960f5debe67 req-1d564ae6-9afb-4a3d-9ffe-5044deaf5472 service nova] Enqueued Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGHEST for action security_group_members [ 858.633526] env[65899]: INFO networking_nsxv3.common.synchronization [req-2ba8068a-b10c-46b7-b145-9960f5debe67 req-1d564ae6-9afb-4a3d-9ffe-5044deaf5472 service nova] Enqueued Resource ID: 1a872c62-fde9-4555-9bc9-2a0f20d8e79c with Priority: HIGHEST for action port [ 858.634169] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGHEST for action security_group_rules [ 858.634275] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGHEST for action security_group_members [ 858.634384] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a872c62-fde9-4555-9bc9-2a0f20d8e79c with Priority: HIGHEST for action port [ 858.634653] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327722f8-ce30-47cb-9d43-141fd71e0315 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.634829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.634829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.635099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.635215] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.636228] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-327722f8-ce30-47cb-9d43-141fd71e0315 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.636348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.636412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.636593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.636772] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.636850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.636978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.637118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.637281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.637324] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.639684] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.639684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.639684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.639684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.639684] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a872c62-fde9-4555-9bc9-2a0f20d8e79c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.715488] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa6250d1-4a11-4b07-8308-040a7f86026a in Status: SUCCESS [ 858.715725] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa6250d1-4a11-4b07-8308-040a7f86026a deletion is rescheduled due to dependency. [ 858.715769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa6250d1-4a11-4b07-8308-040a7f86026a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.140895] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.142045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-327722f8-ce30-47cb-9d43-141fd71e0315 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.142166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.142319] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a872c62-fde9-4555-9bc9-2a0f20d8e79c with status ACTIVE [ 859.142479] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.142582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.142643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.142868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.142918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.143101] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.143205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.143315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.143438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.143523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.143701] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.143830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.143864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.143975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.144059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.144141] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a872c62-fde9-4555-9bc9-2a0f20d8e79c is going to be updated. [ 859.170953] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.171220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.171299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.171601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.172420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.172420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a872c62-fde9-4555-9bc9-2a0f20d8e79c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.646617] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.675981] env[65899]: INFO networking_nsxv3.common.synchronization [req-20bedd6d-3a80-4974-b2cb-812996567990 req-34820045-0e45-44d0-aa5f-03ce2ed2bd9a tempest-ImagesOneServerNegativeTestJSON-1508153592 tempest-ImagesOneServerNegativeTestJSON-1508153592-project-member] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 859.676517] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 859.677075] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.677207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.677277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.677459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.678914] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.678914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.678914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.678914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.678914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.678914] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.731977] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 859.732216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.073746] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.073990] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.074123] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.074406] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.074677] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.074860] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.074998] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.075432] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.075580] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.075778] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.075894] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.076020] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.076172] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.076271] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.076392] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.076501] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.098018] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.098230] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.098362] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.098548] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.098861] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-4332699e-a80a-4e92-b8ca-257a754bcf80 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.099074] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-4332699e-a80a-4e92-b8ca-257a754bcf80" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.099259] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-4332699e-a80a-4e92-b8ca-257a754bcf80" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.099637] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-4332699e-a80a-4e92-b8ca-257a754bcf80" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.099849] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4332699e-a80a-4e92-b8ca-257a754bcf80',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.149850] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.150027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.150108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.151112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.151112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.151112] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327722f8-ce30-47cb-9d43-141fd71e0315 is going to be created. [ 860.176053] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.176255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.176376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.176535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.176690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.180203] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.180321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.180464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.180571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.180877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.180877] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.181360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.181360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.181360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.181360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.181360] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 860.186735] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327722f8-ce30-47cb-9d43-141fd71e0315 in Status: UNINITIALIZED for 2s [ 860.189998] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 860.190289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.226503] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.226730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.226804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.227075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.227261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.237592] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 860.602480] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.602772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.602881] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.603159] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.603347] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.603972] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 4332699e-a80a-4e92-b8ca-257a754bcf80 not found, creating... [ 860.603972] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.604154] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.604308] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.604649] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.604796] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.605132] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.605396] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.605869] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.605994] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.606222] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.606471] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 4332699e-a80a-4e92-b8ca-257a754bcf80 is going to be created. [ 860.633324] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.633597] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.633755] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.634183] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.634449] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.634787] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-4332699e-a80a-4e92-b8ca-257a754bcf80" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.375696] env[65899]: INFO networking_nsxv3.common.synchronization [req-20bedd6d-3a80-4974-b2cb-812996567990 req-c568504b-f5d2-49eb-b5c9-1eec62d5b1b9 service nova] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_rules [ 861.376032] env[65899]: INFO networking_nsxv3.common.synchronization [req-20bedd6d-3a80-4974-b2cb-812996567990 req-c568504b-f5d2-49eb-b5c9-1eec62d5b1b9 service nova] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 861.376085] env[65899]: INFO networking_nsxv3.common.synchronization [req-20bedd6d-3a80-4974-b2cb-812996567990 req-c568504b-f5d2-49eb-b5c9-1eec62d5b1b9 service nova] Enqueued Resource ID: 4332699e-a80a-4e92-b8ca-257a754bcf80 with Priority: HIGHEST for action port [ 861.376700] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_rules [ 861.376860] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 861.376963] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4332699e-a80a-4e92-b8ca-257a754bcf80 with Priority: HIGHEST for action port [ 861.377487] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.377662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.377802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.377974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.378070] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.379121] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.379239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.379482] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-4332699e-a80a-4e92-b8ca-257a754bcf80 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.379571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4332699e-a80a-4e92-b8ca-257a754bcf80" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.379628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4332699e-a80a-4e92-b8ca-257a754bcf80" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.379828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4332699e-a80a-4e92-b8ca-257a754bcf80" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.379937] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4332699e-a80a-4e92-b8ca-257a754bcf80',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.881943] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.881943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.884484] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4332699e-a80a-4e92-b8ca-257a754bcf80 with status ACTIVE [ 861.884785] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.884919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.884967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.885201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.885290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.885478] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.885586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.885702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.885884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.886030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.886519] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.886519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.886668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.886978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.887073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.887161] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4332699e-a80a-4e92-b8ca-257a754bcf80 is going to be updated. [ 861.911453] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.911618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.911686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.911900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.912051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.912218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4332699e-a80a-4e92-b8ca-257a754bcf80" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.199132] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327722f8-ce30-47cb-9d43-141fd71e0315 in Status: SUCCESS [ 862.202090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.203209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.203209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.203209] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.203209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.203209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.203209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.203209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.203209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.203616] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.248787] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 862.248787] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 deletion is rescheduled due to dependency. [ 862.248787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.249201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.249703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.249703] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.249834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.249834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.249968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.250728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.250728] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.707398] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-327722f8-ce30-47cb-9d43-141fd71e0315 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.707729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.707729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.707910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.708109] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.708221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.708302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.708546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.708709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.708880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.709139] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-327722f8-ce30-47cb-9d43-141fd71e0315 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.709271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.709371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.709524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.709690] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.709864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.709864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.710309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.710529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.710529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.710611] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.755194] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.213741] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 327722f8-ce30-47cb-9d43-141fd71e0315: rpc.has_security_group_logging(os_id): False [ 863.239841] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.240970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.240970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.240970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.240970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.241136] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.241229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.241886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.241886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.241886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.242099] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.243879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.244039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.244300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.244493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.244803] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.246078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.246078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.246078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.246078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.246078] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327722f8-ce30-47cb-9d43-141fd71e0315 is going to be created. [ 863.258086] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.315302] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.315502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.315502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.315925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.315925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.331343] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327722f8-ce30-47cb-9d43-141fd71e0315 in Status: IN_PROGRESS for 2s [ 863.761518] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.761518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.761518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.762128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.762128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.762128] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 863.793339] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.793483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.793554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.793866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.793918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.803760] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 865.346337] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 327722f8-ce30-47cb-9d43-141fd71e0315 in Status: SUCCESS [ 865.346337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.823680] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 865.824371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.824621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.824907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.828024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.828024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.828024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.828024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.828024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.828024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.828024] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.332035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.332035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.332035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.332035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.332035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.332687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.332687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.332687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.332687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.332687] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.378185] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 866.378900] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 866.399184] env[65899]: INFO networking_nsxv3.common.synchronization [None req-6ab00d36-158d-481d-8e89-ae23a884eb57 None None] Enqueued Resource ID: c893f776-bccf-46d8-af63-3bcbe6fc286e with Priority: HIGHEST for action port [ 866.399882] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c893f776-bccf-46d8-af63-3bcbe6fc286e with Priority: HIGHEST for action port [ 866.400107] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c893f776-bccf-46d8-af63-3bcbe6fc286e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.400405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c893f776-bccf-46d8-af63-3bcbe6fc286e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.400405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c893f776-bccf-46d8-af63-3bcbe6fc286e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.400569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c893f776-bccf-46d8-af63-3bcbe6fc286e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.400646] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c893f776-bccf-46d8-af63-3bcbe6fc286e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.835864] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 698ff167-530f-4085-8a98-c574783d5ed9: rpc.has_security_group_logging(os_id): False [ 866.862569] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.862730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.862839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.863133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.863255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.863591] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.863708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.863817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.864036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.864178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.864517] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.864682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.864794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.865740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.866099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.866538] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.866670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.866750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.866918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.866999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.867107] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 866.902989] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c893f776-bccf-46d8-af63-3bcbe6fc286e [ 866.903908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.903908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.903908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.903908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.903908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.903908] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c893f776-bccf-46d8-af63-3bcbe6fc286e already deleted. [ 866.903908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c893f776-bccf-46d8-af63-3bcbe6fc286e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.938084] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.938247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.938329] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.938527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.938680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.955473] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 868.973611] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 868.973951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.992191] env[65899]: INFO networking_nsxv3.common.synchronization [None req-478863ac-df2f-461a-929f-d06831cd9e07 None None] Enqueued Resource ID: 394d5c54-8d9d-4abb-8bb6-b163cc83f37b with Priority: HIGHEST for action port [ 868.992191] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394d5c54-8d9d-4abb-8bb6-b163cc83f37b with Priority: HIGHEST for action port [ 868.992191] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-394d5c54-8d9d-4abb-8bb6-b163cc83f37b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.992191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-394d5c54-8d9d-4abb-8bb6-b163cc83f37b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.992191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-394d5c54-8d9d-4abb-8bb6-b163cc83f37b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.992191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-394d5c54-8d9d-4abb-8bb6-b163cc83f37b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.992191] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('394d5c54-8d9d-4abb-8bb6-b163cc83f37b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.499458] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 394d5c54-8d9d-4abb-8bb6-b163cc83f37b [ 869.499458] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.499458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.499458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.499458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.499458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.499458] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:394d5c54-8d9d-4abb-8bb6-b163cc83f37b already deleted. [ 869.499458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-394d5c54-8d9d-4abb-8bb6-b163cc83f37b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.800185] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent loop - iteration:0 completed [ 869.800185] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent loop - iteration:1 started [ 870.189615] env[65899]: INFO networking_nsxv3.common.synchronization [req-5116851e-8aad-4b60-8e16-e01764c13eaa req-140652d7-c732-4839-9816-5c0158b85f28 tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 870.190213] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 870.190749] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.190749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.190749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.190962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.191580] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.191829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.191829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.191949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.192163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.192274] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.586838] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.587105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.587105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.587250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.588028] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.588028] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.588028] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.588028] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.589771] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.590817] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.590817] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.590817] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.590817] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.590817] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.590817] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.592159] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.613638] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.613693] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.614053] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.614053] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.614865] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-6e424831-1acf-4169-8376-fc163bd1e102 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.614865] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-6e424831-1acf-4169-8376-fc163bd1e102" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.614865] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-6e424831-1acf-4169-8376-fc163bd1e102" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.615024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-6e424831-1acf-4169-8376-fc163bd1e102" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.615262] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e424831-1acf-4169-8376-fc163bd1e102',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.695193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.695193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.695193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.695193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.695584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.695584] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.695584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.695683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.695893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.696071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.696071] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 already deleted. [ 870.696150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.118068] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.119134] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.119134] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.120863] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.120863] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.120863] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 6e424831-1acf-4169-8376-fc163bd1e102 not found, creating... [ 871.121047] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.121176] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.121294] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.123051] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.123051] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.123051] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.123051] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.123051] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.123051] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.123051] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.123051] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 6e424831-1acf-4169-8376-fc163bd1e102 is going to be created. [ 871.144092] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.144320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.144465] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.144696] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.144924] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.145164] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-6e424831-1acf-4169-8376-fc163bd1e102" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.922739] env[65899]: INFO networking_nsxv3.common.synchronization [req-5116851e-8aad-4b60-8e16-e01764c13eaa req-cc33ff39-5384-4371-bf27-3cc92fc122b5 service nova] Enqueued Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_rules [ 871.922739] env[65899]: INFO networking_nsxv3.common.synchronization [req-5116851e-8aad-4b60-8e16-e01764c13eaa req-cc33ff39-5384-4371-bf27-3cc92fc122b5 service nova] Enqueued Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 871.922739] env[65899]: INFO networking_nsxv3.common.synchronization [req-5116851e-8aad-4b60-8e16-e01764c13eaa req-cc33ff39-5384-4371-bf27-3cc92fc122b5 service nova] Enqueued Resource ID: 6e424831-1acf-4169-8376-fc163bd1e102 with Priority: HIGHEST for action port [ 871.923226] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_rules [ 871.923403] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 871.923500] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e424831-1acf-4169-8376-fc163bd1e102 with Priority: HIGHEST for action port [ 871.923768] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.923892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.923960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.924451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.924540] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.925978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.926090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.926156] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.926330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.926496] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.926589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.926657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.926991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.927098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.927190] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.927947] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e424831-1acf-4169-8376-fc163bd1e102 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.928263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e424831-1acf-4169-8376-fc163bd1e102" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.928382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e424831-1acf-4169-8376-fc163bd1e102" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.928545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e424831-1acf-4169-8376-fc163bd1e102" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.928621] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e424831-1acf-4169-8376-fc163bd1e102',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.205447] env[65899]: INFO networking_nsxv3.common.synchronization [req-0531851a-1673-4d34-9418-1587d4809d0b req-07ae5122-0b17-4a3a-a4b9-57e0e39af365 tempest-InstanceActionsV221TestJSON-192949492 tempest-InstanceActionsV221TestJSON-192949492-project-member] Enqueued Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGHEST for action security_group_members [ 872.206633] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGHEST for action security_group_members [ 872.206896] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-327722f8-ce30-47cb-9d43-141fd71e0315 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.207088] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.207190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.207497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.207733] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.207903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.208012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.208253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.208409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.208559] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.430596] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.431846] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.431846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.432234] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e424831-1acf-4169-8376-fc163bd1e102 with status ACTIVE [ 872.432972] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.432972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.432972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.432972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.432972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.432972] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.433232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.433232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.433303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.433408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.433595] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.433685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.433743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.433877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.434174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.436716] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e424831-1acf-4169-8376-fc163bd1e102 is going to be updated. [ 872.461299] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.462078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.462078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.462078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.462211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.462752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e424831-1acf-4169-8376-fc163bd1e102" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.711616] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.711760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.711825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.712061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.712148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.712342] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.712434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.712492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.712641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.712711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.712790] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327722f8-ce30-47cb-9d43-141fd71e0315 is going to be updated. [ 872.746568] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.747017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.747779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.747779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.747779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.759837] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327722f8-ce30-47cb-9d43-141fd71e0315 in Status: IN_PROGRESS for 2s [ 872.833333] env[65899]: INFO networking_nsxv3.common.synchronization [None req-a0093577-4c98-4046-bd66-39c3318e040c None None] Enqueued Resource ID: 761400cc-ad36-4c6d-8edc-6241604e480f with Priority: HIGHEST for action port [ 872.835406] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 761400cc-ad36-4c6d-8edc-6241604e480f with Priority: HIGHEST for action port [ 872.835406] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-761400cc-ad36-4c6d-8edc-6241604e480f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.835406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-761400cc-ad36-4c6d-8edc-6241604e480f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.835406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-761400cc-ad36-4c6d-8edc-6241604e480f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.835722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-761400cc-ad36-4c6d-8edc-6241604e480f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.835722] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('761400cc-ad36-4c6d-8edc-6241604e480f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.933453] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.030019] env[65899]: INFO networking_nsxv3.common.synchronization [req-21a4cff6-b6f7-4a8b-8b5c-9d006055cc5f req-363b25f9-9a95-45d7-b9fb-200c9e88295e tempest-ServersTestJSON-298606675 tempest-ServersTestJSON-298606675-project-member] Enqueued Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_members [ 873.030019] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_members [ 873.030019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.030019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.030019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.030019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.030019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.031524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.031835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.033830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.033830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.033830] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.339688] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 761400cc-ad36-4c6d-8edc-6241604e480f [ 873.339688] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.340044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.340044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.340044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.340211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.340211] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:761400cc-ad36-4c6d-8edc-6241604e480f already deleted. [ 873.340303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-761400cc-ad36-4c6d-8edc-6241604e480f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.418421] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-128 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.418726] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-128" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.418916] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-128" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.419596] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-128" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.420049] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.420341] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.421370] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.421370] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.421370] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.421370] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.421370] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.421569] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.421569] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.421688] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.425663] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.425663] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.436658] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.436658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.436658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.436658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.436658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.439455] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 is going to be created. [ 873.442478] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.442478] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.442478] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.442653] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-128" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.443026] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-76d4a828-3d81-4692-b882-4422177848e5 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.443229] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-76d4a828-3d81-4692-b882-4422177848e5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.443387] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-76d4a828-3d81-4692-b882-4422177848e5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.444176] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-76d4a828-3d81-4692-b882-4422177848e5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.444576] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76d4a828-3d81-4692-b882-4422177848e5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.469278] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.469443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.469505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.470263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.470263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.480506] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: UNINITIALIZED for 2s [ 873.535887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.535887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.535887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.536170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.536170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.536317] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.536421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.536484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.536655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.536732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.536815] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d already deleted. [ 873.536911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.947164] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.947491] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.947491] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.949091] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.949091] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.949091] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 76d4a828-3d81-4692-b882-4422177848e5 not found, creating... [ 873.949091] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.949091] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.949091] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.949091] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.949091] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.949438] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.949492] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.949570] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.949848] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.950427] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.950626] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 76d4a828-3d81-4692-b882-4422177848e5 is going to be created. [ 873.973904] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.974152] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.974436] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.974576] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.974813] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.975037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-76d4a828-3d81-4692-b882-4422177848e5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.706063] env[65899]: INFO networking_nsxv3.common.synchronization [req-21a4cff6-b6f7-4a8b-8b5c-9d006055cc5f req-032505fb-23a3-4515-a627-6d285eaf28df service nova] Enqueued Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_rules [ 874.706063] env[65899]: INFO networking_nsxv3.common.synchronization [req-21a4cff6-b6f7-4a8b-8b5c-9d006055cc5f req-032505fb-23a3-4515-a627-6d285eaf28df service nova] Enqueued Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_members [ 874.706063] env[65899]: INFO networking_nsxv3.common.synchronization [req-21a4cff6-b6f7-4a8b-8b5c-9d006055cc5f req-032505fb-23a3-4515-a627-6d285eaf28df service nova] Enqueued Resource ID: 76d4a828-3d81-4692-b882-4422177848e5 with Priority: HIGHEST for action port [ 874.706063] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_rules [ 874.706063] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_members [ 874.706063] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76d4a828-3d81-4692-b882-4422177848e5 with Priority: HIGHEST for action port [ 874.707556] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.707839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.709895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.709895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.709895] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.710701] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.710810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.711061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.711624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.711624] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.711624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.711624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.711624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.711624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.711888] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.712455] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-76d4a828-3d81-4692-b882-4422177848e5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.712573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76d4a828-3d81-4692-b882-4422177848e5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.712627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76d4a828-3d81-4692-b882-4422177848e5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.712758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76d4a828-3d81-4692-b882-4422177848e5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.713718] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76d4a828-3d81-4692-b882-4422177848e5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.770401] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 327722f8-ce30-47cb-9d43-141fd71e0315 in Status: SUCCESS [ 874.770582] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 327722f8-ce30-47cb-9d43-141fd71e0315 deletion is rescheduled due to dependency. [ 874.770717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.214928] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76d4a828-3d81-4692-b882-4422177848e5 with status ACTIVE [ 875.215243] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.217024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.217024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.217024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.217024] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76d4a828-3d81-4692-b882-4422177848e5 is going to be updated. [ 875.217909] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.219404] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.219404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.240674] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.240822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.240822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.241087] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.241174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.241465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76d4a828-3d81-4692-b882-4422177848e5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.494024] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: SUCCESS [ 875.494024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.494024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.494024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.494024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.494024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.494024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.494024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.494024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.494024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.494024] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.720518] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.768078] env[65899]: INFO networking_nsxv3.common.synchronization [None req-7a9a5dea-4531-4ae2-8b7d-3acf13c2f1c8 None None] Enqueued Resource ID: 030fd18b-b79c-4f0c-9732-78165ea29f59 with Priority: HIGHEST for action port [ 875.771019] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 030fd18b-b79c-4f0c-9732-78165ea29f59 with Priority: HIGHEST for action port [ 875.771019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-030fd18b-b79c-4f0c-9732-78165ea29f59 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.771019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-030fd18b-b79c-4f0c-9732-78165ea29f59" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.771019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-030fd18b-b79c-4f0c-9732-78165ea29f59" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.771019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-030fd18b-b79c-4f0c-9732-78165ea29f59" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.771019] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('030fd18b-b79c-4f0c-9732-78165ea29f59',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.910163] env[65899]: INFO networking_nsxv3.common.synchronization [None req-aeff9891-9d70-4ed2-85af-304561718452 None None] Enqueued Resource ID: 1936fad7-a54c-4183-947f-3c204ff435e8 with Priority: HIGHEST for action port [ 875.911412] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1936fad7-a54c-4183-947f-3c204ff435e8 with Priority: HIGHEST for action port [ 875.912068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1936fad7-a54c-4183-947f-3c204ff435e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.914422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1936fad7-a54c-4183-947f-3c204ff435e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.914422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1936fad7-a54c-4183-947f-3c204ff435e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.914422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1936fad7-a54c-4183-947f-3c204ff435e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.914422] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1936fad7-a54c-4183-947f-3c204ff435e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.996734] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.998493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.998744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.998950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.999188] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.999352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.999457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.999694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.999850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.999954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.000140] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.001111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.001111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.001111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.001111] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.001111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.001111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.001111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.001111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.001111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.001111] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.224851] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.224851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.224851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.224851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.224851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.224851] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d is going to be created. [ 876.254839] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.254839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.254839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.254839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.254839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.268930] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: UNINITIALIZED for 2s [ 876.274964] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 030fd18b-b79c-4f0c-9732-78165ea29f59 [ 876.275231] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.275387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.275447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.275631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.275715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.276083] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:030fd18b-b79c-4f0c-9732-78165ea29f59 already deleted. [ 876.276704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-030fd18b-b79c-4f0c-9732-78165ea29f59" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.415403] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1936fad7-a54c-4183-947f-3c204ff435e8 [ 876.415817] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.415817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.417551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.417551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.417551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.417551] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1936fad7-a54c-4183-947f-3c204ff435e8 already deleted. [ 876.417551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1936fad7-a54c-4183-947f-3c204ff435e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.508376] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7823ce5a-b26b-47ed-b253-093353398a68: rpc.has_security_group_logging(os_id): False [ 876.532592] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.532592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.532592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.532592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.532592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.532592] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.532924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.532924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.533348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.533470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.533732] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.533849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.534706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.534706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.534706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.534706] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.534706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.534948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.535132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.535218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.535308] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 is going to be created. [ 876.612673] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.612817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.613748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.613748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.613748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.629639] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: IN_PROGRESS for 2s [ 878.281780] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: SUCCESS [ 878.282190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.282190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.282644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.282644] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.282864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.282864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.282955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.283067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.283158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.283248] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.645819] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: SUCCESS [ 878.645819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.695251] env[65899]: INFO networking_nsxv3.common.synchronization [None req-2279306b-4459-4fd0-b604-708851c5062e None None] Enqueued Resource ID: 1ef3d83c-816c-42eb-917f-ebef78de0d98 with Priority: HIGHEST for action port [ 878.695837] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ef3d83c-816c-42eb-917f-ebef78de0d98 with Priority: HIGHEST for action port [ 878.698777] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ef3d83c-816c-42eb-917f-ebef78de0d98 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.698777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ef3d83c-816c-42eb-917f-ebef78de0d98" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.698777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ef3d83c-816c-42eb-917f-ebef78de0d98" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.698777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ef3d83c-816c-42eb-917f-ebef78de0d98" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.698777] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ef3d83c-816c-42eb-917f-ebef78de0d98',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.786727] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.200593] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ef3d83c-816c-42eb-917f-ebef78de0d98 [ 879.200593] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.200767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.200767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.200903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.201014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.201119] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ef3d83c-816c-42eb-917f-ebef78de0d98 already deleted. [ 879.201312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ef3d83c-816c-42eb-917f-ebef78de0d98" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.292028] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83bf7771-fa03-4285-8780-9b265ead5b3d: rpc.has_security_group_logging(os_id): False [ 879.319682] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.319834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.319977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.320211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.320337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.320681] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.320791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.320855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.321082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.321289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.321289] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d is going to be created. [ 879.399454] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.399454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.400032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.400032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.400201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.417266] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: IN_PROGRESS for 2s [ 880.985092] env[65899]: INFO networking_nsxv3.common.synchronization [req-72a504ac-aad3-4d7e-8652-28bb4d3b4068 req-857778cc-426d-491c-b15a-55d630ec0725 tempest-ServerRescueTestJSON-492744644 tempest-ServerRescueTestJSON-492744644-project-member] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 880.985092] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGHEST for action security_group_members [ 880.985092] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.985092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.985092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.987519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.987519] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.987519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.987519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.987519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.987519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.987519] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.432275] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: SUCCESS [ 881.432275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.489529] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.492819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.492819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.492819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.492819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.492819] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.492819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.492819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.492819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.492819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.492819] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea93861-5728-4289-9609-763ed4d27c02 is going to be updated. [ 881.521870] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.522332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.522513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.522834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.523122] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.532831] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: IN_PROGRESS for 2s [ 882.107550] env[65899]: INFO networking_nsxv3.common.synchronization [req-a68a2a1f-221e-4126-a9a5-06068c81e575 req-7d8656fa-4bca-4036-ab86-a0f4f0bf578a tempest-ServersTestFqdnHostnames-1427128960 tempest-ServersTestFqdnHostnames-1427128960-project-member] Enqueued Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_members [ 882.107550] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGHEST for action security_group_members [ 882.107550] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b46602ad-46c7-4516-bebe-9e57e30f5e16 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.107920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.107920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.108092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.108291] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.108400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.108528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.108673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.108757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.108875] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.616928] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.617138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.617173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.617378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.617472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.617696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.617797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.617894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.618079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.618194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.618266] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 is going to be updated. [ 882.648543] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.648543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.648683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.648780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.650056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.659295] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 in Status: IN_PROGRESS for 2s [ 883.542472] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aea93861-5728-4289-9609-763ed4d27c02 in Status: SUCCESS [ 883.542778] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aea93861-5728-4289-9609-763ed4d27c02 deletion is rescheduled due to dependency. [ 883.542778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.683038] env[65899]: INFO networking_nsxv3.common.synchronization [req-ba178860-b3c7-4d35-9db6-022b521c7efb req-d17c86f9-8125-4c90-b604-93d1f40cfe38 tempest-ImagesOneServerNegativeTestJSON-1508153592 tempest-ImagesOneServerNegativeTestJSON-1508153592-project-member] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 883.683038] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 883.683038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.683038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.683038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.683038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.683038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.683795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.683985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.684251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.684432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.684623] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.188645] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.188935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.189031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.189254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.189537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.189710] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.189818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.189882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.190350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.190350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.190350] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 884.227028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.227028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.227028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.227028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.227028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.235945] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 884.670358] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 in Status: SUCCESS [ 884.670703] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 deletion is rescheduled due to dependency. [ 884.670703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.019162] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3402b3c6-cc0b-4986-be06-48216969665d None None] Enqueued Resource ID: 48953289-59d0-4c64-bf24-765ce4922821 with Priority: HIGHEST for action port [ 885.020905] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48953289-59d0-4c64-bf24-765ce4922821 with Priority: HIGHEST for action port [ 885.023833] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-48953289-59d0-4c64-bf24-765ce4922821 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.023833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48953289-59d0-4c64-bf24-765ce4922821" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.023833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48953289-59d0-4c64-bf24-765ce4922821" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.023833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48953289-59d0-4c64-bf24-765ce4922821" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.023833] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48953289-59d0-4c64-bf24-765ce4922821',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.097813] env[65899]: INFO networking_nsxv3.common.synchronization [req-01838745-197b-4133-b942-f9cba0c059a9 req-1487dd92-8289-4e1a-9028-98b53131191b tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 885.098946] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 885.098946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.098946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.098946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.098946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.101909] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.101909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.101909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.101909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.101909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.101909] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.526322] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48953289-59d0-4c64-bf24-765ce4922821 [ 885.526322] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.526554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.526554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.526665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.526665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.526763] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48953289-59d0-4c64-bf24-765ce4922821 already deleted. [ 885.526916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48953289-59d0-4c64-bf24-765ce4922821" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.541114] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.541114] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.541114] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.541114] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.541114] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.541114] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.541114] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.541114] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.541464] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.541464] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.541601] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.541676] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.541778] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.541882] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.541976] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.542111] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.562086] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.562289] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.562423] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.562587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.562940] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-81316e7c-68cc-4228-85d5-697b8be93a00 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.563126] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-81316e7c-68cc-4228-85d5-697b8be93a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.563235] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-81316e7c-68cc-4228-85d5-697b8be93a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.563599] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-81316e7c-68cc-4228-85d5-697b8be93a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.563735] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81316e7c-68cc-4228-85d5-697b8be93a00',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.606129] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.606129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.606363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.606396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.606456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.606977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.606977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.606977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.607197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.607197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.607311] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 885.635146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.635146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.635146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.635318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.635318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.645014] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 886.066029] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.066312] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.066312] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.067040] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.067201] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.067357] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 81316e7c-68cc-4228-85d5-697b8be93a00 not found, creating... [ 886.067617] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.067834] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.067954] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.068250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.068404] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.068702] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.068990] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.068990] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.069199] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.069303] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.069512] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 81316e7c-68cc-4228-85d5-697b8be93a00 is going to be created. [ 886.090963] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.092182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.092182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.092182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.092438] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.092645] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-81316e7c-68cc-4228-85d5-697b8be93a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.249378] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 886.249614] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 deletion is rescheduled due to dependency. [ 886.249764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.879795] env[65899]: INFO networking_nsxv3.common.synchronization [req-01838745-197b-4133-b942-f9cba0c059a9 req-742eaf8e-f4ea-4904-8005-82f61e3aa029 service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 886.879795] env[65899]: INFO networking_nsxv3.common.synchronization [req-01838745-197b-4133-b942-f9cba0c059a9 req-742eaf8e-f4ea-4904-8005-82f61e3aa029 service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 886.879795] env[65899]: INFO networking_nsxv3.common.synchronization [req-01838745-197b-4133-b942-f9cba0c059a9 req-742eaf8e-f4ea-4904-8005-82f61e3aa029 service nova] Enqueued Resource ID: 81316e7c-68cc-4228-85d5-697b8be93a00 with Priority: HIGHEST for action port [ 886.879795] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 886.880051] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 886.880051] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81316e7c-68cc-4228-85d5-697b8be93a00 with Priority: HIGHEST for action port [ 886.880316] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.880897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.880897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.880897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.880897] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.884356] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.884535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.884747] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-81316e7c-68cc-4228-85d5-697b8be93a00 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.884856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81316e7c-68cc-4228-85d5-697b8be93a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.885056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81316e7c-68cc-4228-85d5-697b8be93a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.885115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81316e7c-68cc-4228-85d5-697b8be93a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.885163] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81316e7c-68cc-4228-85d5-697b8be93a00',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.390908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.390908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.390908] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81316e7c-68cc-4228-85d5-697b8be93a00 with status ACTIVE [ 887.390908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.390908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.390908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.390908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.390908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.391805] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.392169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.392318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.393213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.393411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.394216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.394460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.395025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.395291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.396105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.396105] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81316e7c-68cc-4228-85d5-697b8be93a00 is going to be updated. [ 887.417137] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.417137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.418136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.418136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.418136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.418136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81316e7c-68cc-4228-85d5-697b8be93a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.466168] env[65899]: INFO networking_nsxv3.common.synchronization [req-c5ecb227-1261-4604-bb3b-8aabf4129760 req-7dca6bcc-1202-4d11-9179-c4cca59e556a tempest-VolumesAdminNegativeTest-1692019033 tempest-VolumesAdminNegativeTest-1692019033-project-member] Enqueued Resource ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 with Priority: HIGHEST for action security_group_members [ 887.466741] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 with Priority: HIGHEST for action security_group_members [ 887.467072] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2af4f432-9b80-40ee-9230-997d5fd46f40 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.467194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.467257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.467503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.467665] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.467844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.467928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.468103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.468230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.468408] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2af4f432-9b80-40ee-9230-997d5fd46f40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.655509] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 887.655750] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 deletion is rescheduled due to dependency. [ 887.655846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.656427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.656427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.656427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.656710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.656710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.656710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.657032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.657032] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.715957] env[65899]: INFO networking_nsxv3.common.synchronization [None req-53107a95-49bf-4bae-a7c0-0e841c428519 None None] Enqueued Resource ID: c9c3eca2-8441-497f-b55b-5c87fd97d3a9 with Priority: HIGHEST for action port [ 887.716369] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9c3eca2-8441-497f-b55b-5c87fd97d3a9 with Priority: HIGHEST for action port [ 887.717144] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9c3eca2-8441-497f-b55b-5c87fd97d3a9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.717144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9c3eca2-8441-497f-b55b-5c87fd97d3a9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.717144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9c3eca2-8441-497f-b55b-5c87fd97d3a9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.717411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9c3eca2-8441-497f-b55b-5c87fd97d3a9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.717411] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9c3eca2-8441-497f-b55b-5c87fd97d3a9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.917485] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.918665] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-529" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.918850] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-529" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.919274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-529" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.919656] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.919823] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.920021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.920232] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.920369] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.920611] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.920733] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.920852] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.920954] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.921079] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.921182] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.921308] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.946709] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.946988] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.947258] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.947540] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-529" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.948060] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.948319] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.948491] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.948922] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.949197] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('783b2c78-7ec3-4e86-98ae-4d9088f7b1fe',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.972360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.972598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.972729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.973064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.973209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.974032] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.974032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.974032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.974032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.974264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.974264] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 already deleted. [ 887.974385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.161734] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.222568] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c9c3eca2-8441-497f-b55b-5c87fd97d3a9 [ 888.223154] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.223154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.223154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.223353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.223420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.223472] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c9c3eca2-8441-497f-b55b-5c87fd97d3a9 already deleted. [ 888.223568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9c3eca2-8441-497f-b55b-5c87fd97d3a9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.454140] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.454447] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.454447] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.454734] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.454872] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.455023] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 783b2c78-7ec3-4e86-98ae-4d9088f7b1fe not found, creating... [ 888.455264] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.455408] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.455514] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.455732] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.457017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.457017] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.457017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.457017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.457017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.457017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.458861] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 783b2c78-7ec3-4e86-98ae-4d9088f7b1fe is going to be created. [ 888.482724] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.482992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.483124] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.483392] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.483687] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.483915] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.665052] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.168671] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.168868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.168929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.172019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.172019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.172019] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 889.212020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.212266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.212266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.212432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.212566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.224117] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 889.249339] env[65899]: INFO networking_nsxv3.common.synchronization [req-c5ecb227-1261-4604-bb3b-8aabf4129760 req-48ddc49a-da4b-405a-b135-806617493f74 service nova] Enqueued Resource ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 with Priority: HIGHEST for action security_group_rules [ 889.249505] env[65899]: INFO networking_nsxv3.common.synchronization [req-c5ecb227-1261-4604-bb3b-8aabf4129760 req-48ddc49a-da4b-405a-b135-806617493f74 service nova] Enqueued Resource ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 with Priority: HIGHEST for action security_group_members [ 889.249643] env[65899]: INFO networking_nsxv3.common.synchronization [req-c5ecb227-1261-4604-bb3b-8aabf4129760 req-48ddc49a-da4b-405a-b135-806617493f74 service nova] Enqueued Resource ID: 783b2c78-7ec3-4e86-98ae-4d9088f7b1fe with Priority: HIGHEST for action port [ 889.250194] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 with Priority: HIGHEST for action security_group_rules [ 889.251191] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 with Priority: HIGHEST for action security_group_members [ 889.251246] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 783b2c78-7ec3-4e86-98ae-4d9088f7b1fe with Priority: HIGHEST for action port [ 889.251745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2af4f432-9b80-40ee-9230-997d5fd46f40 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.251864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.251917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.252143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.252227] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2af4f432-9b80-40ee-9230-997d5fd46f40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.253077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2af4f432-9b80-40ee-9230-997d5fd46f40 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.253198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.253265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.253429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.253580] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.253686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.253749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.253886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.253970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.254071] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2af4f432-9b80-40ee-9230-997d5fd46f40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.254886] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.254992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.255882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.255882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.255882] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('783b2c78-7ec3-4e86-98ae-4d9088f7b1fe',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.758187] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2af4f432-9b80-40ee-9230-997d5fd46f40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.758552] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2af4f432-9b80-40ee-9230-997d5fd46f40 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.758685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.759375] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 783b2c78-7ec3-4e86-98ae-4d9088f7b1fe with status ACTIVE [ 889.759375] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.759375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.759375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.759375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.759625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.759625] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.759703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.759744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.759988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.759988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.760141] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.760203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.761034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.761034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.761034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.761034] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 783b2c78-7ec3-4e86-98ae-4d9088f7b1fe is going to be updated. [ 889.782933] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.783136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.783220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.783462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.783686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.784175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-783b2c78-7ec3-4e86-98ae-4d9088f7b1fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.263183] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2af4f432-9b80-40ee-9230-997d5fd46f40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.769068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.769068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.769068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.769068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.769068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.769068] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 is going to be created. [ 890.794151] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.794151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.794151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.794486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.794486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.803997] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 in Status: UNINITIALIZED for 2s [ 891.237017] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 891.237387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.237822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.237890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.239073] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.239073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.239073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.239073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.239073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.239073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.239073] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.743071] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.743267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.743347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.743539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.743751] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.743874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.743919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.744094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.744196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.744252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.744414] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.744494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.744553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.744723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.744966] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.745119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.745213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.745260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.745338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.745420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.745520] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.248057] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc14a464-84a2-4f30-88ae-7b0da98e4e95: rpc.has_security_group_logging(os_id): False [ 892.266232] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.266387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.266465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.266684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.266789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.266974] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.267191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.267265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.267417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.267538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.267725] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.267792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.267856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.268014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.268102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.268290] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.269173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.269173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.269173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.269173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.269173] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 892.332014] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.332167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.332388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.332791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.333076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.349473] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 892.816574] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 in Status: SUCCESS [ 892.816850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.817061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.817331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.817558] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.817706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.817818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.819147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.819147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.819147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.819147] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2af4f432-9b80-40ee-9230-997d5fd46f40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.321783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2af4f432-9b80-40ee-9230-997d5fd46f40 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.322100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.322100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.322308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.322485] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.322591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.322657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.322824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.322914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.323007] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.323155] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2af4f432-9b80-40ee-9230-997d5fd46f40 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.323246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.323307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.323446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.323666] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.323789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.323863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.324018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.324111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.324190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.324278] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2af4f432-9b80-40ee-9230-997d5fd46f40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.826441] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2af4f432-9b80-40ee-9230-997d5fd46f40: rpc.has_security_group_logging(os_id): False [ 893.845133] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.845324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.845324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.845545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.845635] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.845851] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.845964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.846058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.846216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.846305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.846493] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.846588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.846648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.846786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.846858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.847726] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.847901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.847973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.848579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.848579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.848579] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 is going to be created. [ 893.909512] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.909690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.909826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.909952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.910179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.922087] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 in Status: IN_PROGRESS for 2s [ 894.015152] env[65899]: INFO networking_nsxv3.common.synchronization [req-866340cf-ca14-4c96-ab23-463810e0c95c req-7c0714b2-e4a9-4cb9-8e37-0258e4794741 tempest-ListImageFiltersTestJSON-940002557 tempest-ListImageFiltersTestJSON-940002557-project-member] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 894.016641] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 894.016641] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.016641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.016641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.016875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.016964] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.017059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.017122] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.017281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.017363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.017454] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.362619] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 894.362946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.523774] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.026738] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.530639] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.531057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.531057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.531243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.531243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.531331] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085ff348-1812-4078-9ad5-3958496f698b is going to be updated. [ 895.562057] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.562213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.562279] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.562482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.562625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.573599] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: IN_PROGRESS for 2s [ 895.937905] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 in Status: SUCCESS [ 895.937905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.123082] env[65899]: INFO networking_nsxv3.common.synchronization [req-4a1ece7c-4676-4928-8557-785318a5762e req-51f2c9c8-6223-4add-9ae3-82f97a9c9003 tempest-TenantUsagesTestJSON-519081158 tempest-TenantUsagesTestJSON-519081158-project-member] Enqueued Resource ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 with Priority: HIGHEST for action security_group_members [ 897.123790] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 with Priority: HIGHEST for action security_group_members [ 897.123790] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.123947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.124021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.124726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.124926] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.125071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.125203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.125381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.125467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.125563] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbbd5a6a-d11b-47e8-a835-6b824a5963a5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.456246] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.456442] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.456569] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.456858] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.457106] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.457241] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.457349] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.457562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.457731] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.457897] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.458010] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.458655] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.458776] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.458892] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.458995] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.459143] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.482237] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.482411] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.482543] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.482714] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.483033] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-30984796-f7ad-4592-9339-d00533a4c443 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.483202] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-30984796-f7ad-4592-9339-d00533a4c443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.483315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-30984796-f7ad-4592-9339-d00533a4c443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.483631] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-30984796-f7ad-4592-9339-d00533a4c443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.483848] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30984796-f7ad-4592-9339-d00533a4c443',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.583053] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: SUCCESS [ 897.583175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.630724] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.630960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.631073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.631679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.631679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.631679] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.631856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.631856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.632042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.632141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.632259] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 already deleted. [ 897.632350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.987378] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.987612] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.987685] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.988334] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.988619] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.988775] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 30984796-f7ad-4592-9339-d00533a4c443 not found, creating... [ 897.989055] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.989213] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.989325] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.989557] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.989687] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.989964] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.990132] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.990235] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.990438] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.990560] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.990691] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 30984796-f7ad-4592-9339-d00533a4c443 is going to be created. [ 898.017754] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.018032] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.018200] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.018523] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.018805] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.019083] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-30984796-f7ad-4592-9339-d00533a4c443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.748061] env[65899]: INFO networking_nsxv3.common.synchronization [req-4a1ece7c-4676-4928-8557-785318a5762e req-9b02c0ea-31fd-4ab4-911d-a23f7a5728b8 service nova] Enqueued Resource ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 with Priority: HIGHEST for action security_group_rules [ 898.748317] env[65899]: INFO networking_nsxv3.common.synchronization [req-4a1ece7c-4676-4928-8557-785318a5762e req-9b02c0ea-31fd-4ab4-911d-a23f7a5728b8 service nova] Enqueued Resource ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 with Priority: HIGHEST for action security_group_members [ 898.748372] env[65899]: INFO networking_nsxv3.common.synchronization [req-4a1ece7c-4676-4928-8557-785318a5762e req-9b02c0ea-31fd-4ab4-911d-a23f7a5728b8 service nova] Enqueued Resource ID: 30984796-f7ad-4592-9339-d00533a4c443 with Priority: HIGHEST for action port [ 898.748864] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 with Priority: HIGHEST for action security_group_rules [ 898.749208] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 with Priority: HIGHEST for action security_group_members [ 898.749382] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30984796-f7ad-4592-9339-d00533a4c443 with Priority: HIGHEST for action port [ 898.749736] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbbd5a6a-d11b-47e8-a835-6b824a5963a5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.749928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.750054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.750336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.750463] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbbd5a6a-d11b-47e8-a835-6b824a5963a5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.752370] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.752370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.752506] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.752837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.753886] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.753886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.753886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.754057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.754323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.754636] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbbd5a6a-d11b-47e8-a835-6b824a5963a5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.755869] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-30984796-f7ad-4592-9339-d00533a4c443 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.755981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30984796-f7ad-4592-9339-d00533a4c443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.756082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30984796-f7ad-4592-9339-d00533a4c443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.756306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30984796-f7ad-4592-9339-d00533a4c443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.756454] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30984796-f7ad-4592-9339-d00533a4c443',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.252702] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.252702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.256535] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbbd5a6a-d11b-47e8-a835-6b824a5963a5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.259243] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30984796-f7ad-4592-9339-d00533a4c443 with status ACTIVE [ 899.259243] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.259243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.259243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.259243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.259243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.259243] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.259243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.259243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.259243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.259243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.259753] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.259753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.259753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.259753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.259753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.259953] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30984796-f7ad-4592-9339-d00533a4c443 is going to be updated. [ 899.280662] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.280804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.280885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.281092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.281225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.281376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30984796-f7ad-4592-9339-d00533a4c443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.761403] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbbd5a6a-d11b-47e8-a835-6b824a5963a5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.264256] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.264416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.264486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.264715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.265605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.265605] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 is going to be created. [ 900.289112] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.289112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.289226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.289916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.289916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.299114] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 in Status: UNINITIALIZED for 2s [ 902.081017] env[65899]: INFO networking_nsxv3.common.synchronization [req-69db1963-39a8-4688-85ad-36e374e4d1dd req-9e820d17-780e-407f-a1aa-4b88920f2471 tempest-InstanceActionsNegativeTestJSON-899149509 tempest-InstanceActionsNegativeTestJSON-899149509-project-member] Enqueued Resource ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 with Priority: HIGHEST for action security_group_members [ 902.081017] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 with Priority: HIGHEST for action security_group_members [ 902.083309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea1a19d6-ac31-4e61-b250-037c90dc02d6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.083309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.083309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.083309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.083309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.083309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.083309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.083309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.083309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.083309] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea1a19d6-ac31-4e61-b250-037c90dc02d6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.281141] env[65899]: INFO networking_nsxv3.common.synchronization [req-99d41e4f-6c35-4227-8b54-119428055e22 req-599d805f-87f5-4f97-8367-e23296092e30 tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 902.281458] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 902.281768] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.281888] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.281952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.282157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.282307] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.282401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.282462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.282610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.282723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.282847] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.316035] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 in Status: SUCCESS [ 902.316035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.316035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.316035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.316035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.316035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.316035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.316035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.316035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.316035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.316035] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbbd5a6a-d11b-47e8-a835-6b824a5963a5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.506554] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-124 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.509320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-124" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.509320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-124" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.509320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-124" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.509320] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.509320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.509320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.509320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.509320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.509320] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.509320] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.509320] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.509320] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.509320] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.509320] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.509320] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.528847] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.529023] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.529155] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.529326] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-124" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.529630] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.529796] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.529910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.530235] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.530361] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0af28e6-8eb2-4391-ac18-21f0a03a8f6e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.590107] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.590633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.591009] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.591280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.591463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.592758] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.592758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.592758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.592758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.592758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.592758] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 already deleted. [ 902.592758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.785179] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.785179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.785289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.785467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.785590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.786192] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.786192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.786192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.786192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.786192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.786931] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 is going to be updated. [ 902.819696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.819696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.819696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.819696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.819696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.819696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.819696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.819696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.820048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.820048] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.820544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.820626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.820754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.820830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.820915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.821299] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.821299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.821299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.821471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.821521] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.821640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.821717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.821857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.821947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.822038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.822247] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbbd5a6a-d11b-47e8-a835-6b824a5963a5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.833026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: IN_PROGRESS for 2s [ 903.033659] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.034571] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.034571] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.034571] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.034571] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.034769] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port c0af28e6-8eb2-4391-ac18-21f0a03a8f6e not found, creating... [ 903.034964] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.035176] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.035319] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.035555] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.035688] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.035962] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.036172] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.036259] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.036455] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.036561] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.037250] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: c0af28e6-8eb2-4391-ac18-21f0a03a8f6e is going to be created. [ 903.057313] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.058562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.058562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.058562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.058562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.058562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.324958] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbbd5a6a-d11b-47e8-a835-6b824a5963a5: rpc.has_security_group_logging(os_id): False [ 903.347297] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.347572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.347654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.347843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.347928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.348144] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.348291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.348291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.348436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.348507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.348692] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.348778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.348826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.349081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.349174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.349370] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.349453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.349513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.349653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.349717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.349848] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 is going to be created. [ 903.423042] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.423256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.423256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.423481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.423639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.435961] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 in Status: IN_PROGRESS for 2s [ 903.808831] env[65899]: INFO networking_nsxv3.common.synchronization [req-69db1963-39a8-4688-85ad-36e374e4d1dd req-626cb630-79e5-4de1-8dbb-1708abc544c3 service nova] Enqueued Resource ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 with Priority: HIGHEST for action security_group_rules [ 903.809042] env[65899]: INFO networking_nsxv3.common.synchronization [req-69db1963-39a8-4688-85ad-36e374e4d1dd req-626cb630-79e5-4de1-8dbb-1708abc544c3 service nova] Enqueued Resource ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 with Priority: HIGHEST for action security_group_members [ 903.809199] env[65899]: INFO networking_nsxv3.common.synchronization [req-69db1963-39a8-4688-85ad-36e374e4d1dd req-626cb630-79e5-4de1-8dbb-1708abc544c3 service nova] Enqueued Resource ID: c0af28e6-8eb2-4391-ac18-21f0a03a8f6e with Priority: HIGHEST for action port [ 903.809838] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 with Priority: HIGHEST for action security_group_rules [ 903.809955] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 with Priority: HIGHEST for action security_group_members [ 903.810237] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0af28e6-8eb2-4391-ac18-21f0a03a8f6e with Priority: HIGHEST for action port [ 903.810586] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea1a19d6-ac31-4e61-b250-037c90dc02d6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.810722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.810824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.812033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.812100] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea1a19d6-ac31-4e61-b250-037c90dc02d6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.812960] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea1a19d6-ac31-4e61-b250-037c90dc02d6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.813083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.813155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.813341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.813503] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.813607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.813672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.813842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.813919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.814047] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea1a19d6-ac31-4e61-b250-037c90dc02d6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.816134] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.816134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.816134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.816134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.816134] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0af28e6-8eb2-4391-ac18-21f0a03a8f6e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.317345] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea1a19d6-ac31-4e61-b250-037c90dc02d6 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.317492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.317716] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea1a19d6-ac31-4e61-b250-037c90dc02d6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.318804] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0af28e6-8eb2-4391-ac18-21f0a03a8f6e with status ACTIVE [ 904.318941] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.319079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.319144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.319407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.319529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.319739] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.319875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.319973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.320181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.320231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.320410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.320512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.320570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.320744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.320817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.320898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0af28e6-8eb2-4391-ac18-21f0a03a8f6e is going to be updated. [ 904.362415] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.362858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.362858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.362935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.363063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.363261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0af28e6-8eb2-4391-ac18-21f0a03a8f6e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.734759] env[65899]: INFO networking_nsxv3.common.synchronization [req-9cffe27f-ec62-4308-bb6e-6dc18f721b04 req-af904a6b-15dc-450e-bf09-3882cbb53720 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_members [ 904.735759] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_members [ 904.736103] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.736229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.736312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.736579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.736740] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.736859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.736922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.737091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.737191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.737285] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.824406] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea1a19d6-ac31-4e61-b250-037c90dc02d6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.846120] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: SUCCESS [ 904.846120] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 deletion is rescheduled due to dependency. [ 904.846120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.924671] env[65899]: INFO networking_nsxv3.common.synchronization [req-6499f206-50c7-4f9e-a054-1118e5af33de req-41b76f0a-9314-4039-ae38-b63e727a2ee6 tempest-VolumesAdminNegativeTest-1692019033 tempest-VolumesAdminNegativeTest-1692019033-project-member] Enqueued Resource ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 with Priority: HIGHEST for action security_group_members [ 904.925641] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 with Priority: HIGHEST for action security_group_members [ 904.926298] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2af4f432-9b80-40ee-9230-997d5fd46f40 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.926298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.926298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.926522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.926559] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.926686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.926733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.926867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.927613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.927613] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2af4f432-9b80-40ee-9230-997d5fd46f40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.133850] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.134100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.134307] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.134519] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.134822] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.135058] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.135204] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.135442] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.135619] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.135848] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.136080] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.136172] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.136230] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.136332] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.136450] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.136633] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.157985] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.157985] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.157985] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.157985] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.157985] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-bdb08399-09b7-4567-8d42-b8dd365ebc97 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.158329] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-bdb08399-09b7-4567-8d42-b8dd365ebc97" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.158329] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-bdb08399-09b7-4567-8d42-b8dd365ebc97" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.159159] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-bdb08399-09b7-4567-8d42-b8dd365ebc97" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.159159] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdb08399-09b7-4567-8d42-b8dd365ebc97',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.241374] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.241567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.241685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.241941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.242055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.242314] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.242428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.242506] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.242678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.242783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.242874] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 already deleted. [ 905.243008] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.331214] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.331214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.331214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.331214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.331214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.331214] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 is going to be created. [ 905.359397] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.359397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.359397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.359397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.359397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.369221] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 in Status: UNINITIALIZED for 2s [ 905.432473] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.432473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.432473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.432473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.432473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.432743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.432837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.432883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.433202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.433321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.433458] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 is going to be updated. [ 905.462994] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 in Status: SUCCESS [ 905.462994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.508109] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.508258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.508258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.508463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.508601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.528460] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 in Status: IN_PROGRESS for 2s [ 905.661148] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.661374] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.661510] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.661853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.662016] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.662193] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port bdb08399-09b7-4567-8d42-b8dd365ebc97 not found, creating... [ 905.662448] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.662602] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.662729] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.662956] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.663111] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.663404] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.663556] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.663669] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.663936] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.664128] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.664253] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: bdb08399-09b7-4567-8d42-b8dd365ebc97 is going to be created. [ 905.685125] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.685410] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.685524] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.685869] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.686164] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.686459] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-bdb08399-09b7-4567-8d42-b8dd365ebc97" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.736058] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.736300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.736371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.736579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.736686] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.240259] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.439542] env[65899]: INFO networking_nsxv3.common.synchronization [req-9cffe27f-ec62-4308-bb6e-6dc18f721b04 req-23bd28c4-f790-4212-a28a-8144ec005d52 service nova] Enqueued Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_rules [ 906.439778] env[65899]: INFO networking_nsxv3.common.synchronization [req-9cffe27f-ec62-4308-bb6e-6dc18f721b04 req-23bd28c4-f790-4212-a28a-8144ec005d52 service nova] Enqueued Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_members [ 906.439914] env[65899]: INFO networking_nsxv3.common.synchronization [req-9cffe27f-ec62-4308-bb6e-6dc18f721b04 req-23bd28c4-f790-4212-a28a-8144ec005d52 service nova] Enqueued Resource ID: bdb08399-09b7-4567-8d42-b8dd365ebc97 with Priority: HIGHEST for action port [ 906.440399] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_rules [ 906.440530] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_members [ 906.440624] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb08399-09b7-4567-8d42-b8dd365ebc97 with Priority: HIGHEST for action port [ 906.440978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.441078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.441175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.441382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.441463] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.442303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.444134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.444134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.444134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.444134] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.444134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.444134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.444134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.444134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.444134] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.446207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdb08399-09b7-4567-8d42-b8dd365ebc97 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.446207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdb08399-09b7-4567-8d42-b8dd365ebc97" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.446207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdb08399-09b7-4567-8d42-b8dd365ebc97" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.446207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdb08399-09b7-4567-8d42-b8dd365ebc97" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.446207] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdb08399-09b7-4567-8d42-b8dd365ebc97',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.742551] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.948211] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.948889] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.949090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.949245] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdb08399-09b7-4567-8d42-b8dd365ebc97 with status ACTIVE [ 906.949427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.949536] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.949598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.949815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.949897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.950724] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.950724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.950724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.950724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.950724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.950724] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.950724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.951276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.951276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.951276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.953429] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdb08399-09b7-4567-8d42-b8dd365ebc97 is going to be updated. [ 906.985143] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.985349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.985442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.985655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.985807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.985975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdb08399-09b7-4567-8d42-b8dd365ebc97" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.252623] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 907.252623] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 907.381022] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 in Status: SUCCESS [ 907.381022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.381022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.381022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.381288] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.381288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.381288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.381411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.381507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.381545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.382159] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea1a19d6-ac31-4e61-b250-037c90dc02d6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.459106] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.541313] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 in Status: SUCCESS [ 907.541313] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2af4f432-9b80-40ee-9230-997d5fd46f40 deletion is rescheduled due to dependency. [ 907.541313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2af4f432-9b80-40ee-9230-997d5fd46f40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.886021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea1a19d6-ac31-4e61-b250-037c90dc02d6 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.886021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.886021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.886021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.886021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.886021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.886021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.886474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.886891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.887169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.887512] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea1a19d6-ac31-4e61-b250-037c90dc02d6 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.887803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.887961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.888968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.889213] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.889325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.891597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.891597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.891597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.891597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.891597] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea1a19d6-ac31-4e61-b250-037c90dc02d6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.964134] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.964318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.964402] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.964690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.964806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.964936] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 is going to be created. [ 907.993610] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.993776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.993910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.995270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.995270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.011071] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 in Status: UNINITIALIZED for 2s [ 908.130909] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.130909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.130909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.130909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.144334] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 908.145537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.148405] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 908.180711] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.182411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.183251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.183251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.192353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.193087] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 908.193191] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 908.193341] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 908.239029] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.239029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.239029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.239618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.241508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.243020] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 908.319898] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.320234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.320405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.320782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.321287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.321912] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 908.398310] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.402038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.402038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.402038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.402038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.402038] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 908.402038] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8ebe8c18-10e1-409f-82d4-0340ed451137', '974c962f-0ed5-4445-b566-b0cc5bb30621', 'c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3', '327722f8-ce30-47cb-9d43-141fd71e0315', '4b1b07c8-6f18-4d08-b906-df258186de4a', '58bb0b54-538c-449e-bd48-369e68a81947', '04e3d21c-6754-446b-b0ca-61b5ed8f6a3b', 'fc14a464-84a2-4f30-88ae-7b0da98e4e95', '6305f884-2f1c-4192-bb40-952ed6eaf542', 'ccb53a98-d213-45f3-8ad2-09830fe9ee60', '78fc9585-54a3-4e16-8c58-5b307977bb8e', 'e5b339ac-01aa-4f28-9e73-9f48477e571d', '83bf7771-fa03-4285-8780-9b265ead5b3d', '6607a38e-6205-4531-b5e6-7fd1d3e900ea', '07b5dcdc-e0c4-4d5a-9f24-d000aad5b631', '743c5a69-4fa0-4875-ab4b-14b45b31c03c', 'aea93861-5728-4289-9609-763ed4d27c02', '085ff348-1812-4078-9ad5-3958496f698b', 'd97c0b7d-58d1-4baf-97be-f3a035518398', 'b46602ad-46c7-4516-bebe-9e57e30f5e16', '8e8e18e2-41de-44dd-a97f-655de1cca16f', 'fa6250d1-4a11-4b07-8308-040a7f86026a', 'e6efcb92-8e15-4172-8949-8449dfa15fb3', 'bbdddd19-b5d8-4409-9731-8dacfc9c1c1a', '2af4f432-9b80-40ee-9230-997d5fd46f40', 'dbbd5a6a-d11b-47e8-a835-6b824a5963a5', '7823ce5a-b26b-47ed-b253-093353398a68', 'dad04559-d224-486f-adbe-3d9a2df06d0a', '698ff167-530f-4085-8a98-c574783d5ed9', '80a77268-fa72-46b8-ba25-eed73b0ba36a', 'fdbdafb6-4c78-4b83-b960-c24d6a937e53', 'c9813fef-8c97-4cb6-92ff-4d01107ef382'} {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 908.402038] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 908.402038] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea1a19d6-ac31-4e61-b250-037c90dc02d6: rpc.has_security_group_logging(os_id): False [ 908.440605] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.440973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.441098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.441446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.441610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.441830] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 908.441975] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 908.442124] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 908.444809] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.444965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.445044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.445294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.445383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.445607] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.445713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.445775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.446404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.446551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.446807] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.446908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.446972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.447159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.447246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.447452] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.447548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.447603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.447767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.447841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.447927] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 is going to be created. [ 908.557065] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.557065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.557065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.557065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.557065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.571043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.571283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.571283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.573034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.573034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.573263] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 908.573340] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 908.573412] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 908.573473] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 908.573553] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/32 resources of Type:Security Group Rules [ 908.573644] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGH for action security_group_rules [ 908.573832] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGH for action security_group_rules [ 908.573987] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGH for action security_group_rules [ 908.574120] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGH for action security_group_rules [ 908.574218] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGH for action security_group_rules [ 908.574285] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGH for action security_group_rules [ 908.574346] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGH for action security_group_rules [ 908.574404] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGH for action security_group_rules [ 908.574477] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGH for action security_group_rules [ 908.574527] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGH for action security_group_rules [ 908.574609] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGH for action security_group_rules [ 908.574672] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGH for action security_group_rules [ 908.574731] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGH for action security_group_rules [ 908.574791] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGH for action security_group_rules [ 908.575042] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGH for action security_group_rules [ 908.575042] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGH for action security_group_rules [ 908.575042] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGH for action security_group_rules [ 908.575042] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGH for action security_group_rules [ 908.575248] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGH for action security_group_rules [ 908.575248] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGH for action security_group_rules [ 908.575248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.583060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 in Status: IN_PROGRESS for 2s [ 910.023687] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 in Status: SUCCESS [ 910.024091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.024187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.024379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.024658] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.024822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.024933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.025169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.025256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.025393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.025532] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.528435] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.598794] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 in Status: SUCCESS [ 910.599428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.036474] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 468d9cb4-d57c-4a08-8f21-b2ebb70bca61: rpc.has_security_group_logging(os_id): False [ 911.062779] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.062779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.062779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.062779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.062779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.062779] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.062779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.062779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.062779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.062779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.062779] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 is going to be created. [ 911.120626] env[65899]: INFO networking_nsxv3.common.synchronization [None req-315f0622-5ac1-4530-9f50-0a6a8f9e10f2 None None] Enqueued Resource ID: 4a4f425c-32f7-4ed6-9a9d-94fde134a425 with Priority: HIGHEST for action port [ 911.122148] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4f425c-32f7-4ed6-9a9d-94fde134a425 with Priority: HIGHEST for action port [ 911.122396] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 with Priority: HIGH for action security_group_rules [ 911.122594] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGH for action security_group_rules [ 911.122790] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGH for action security_group_rules [ 911.122946] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGH for action security_group_rules [ 911.123072] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 with Priority: HIGH for action security_group_rules [ 911.123192] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGH for action security_group_rules [ 911.123323] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGH for action security_group_rules [ 911.123448] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea93861-5728-4289-9609-763ed4d27c02 with Priority: HIGH for action security_group_rules [ 911.123669] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea with Priority: HIGH for action security_group_rules [ 911.123762] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGH for action security_group_rules [ 911.124014] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGH for action security_group_rules [ 911.124147] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGH for action security_group_rules [ 911.124255] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e with Priority: HIGH for action security_group_rules [ 911.124377] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 with Priority: HIGH for action security_group_rules [ 911.124470] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGH for action security_group_rules [ 911.124558] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58bb0b54-538c-449e-bd48-369e68a81947 with Priority: HIGH for action security_group_rules [ 911.124714] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGH for action security_group_rules [ 911.124789] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1b07c8-6f18-4d08-b906-df258186de4a with Priority: HIGH for action security_group_rules [ 911.124927] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 with Priority: HIGH for action security_group_rules [ 911.125282] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 327722f8-ce30-47cb-9d43-141fd71e0315 with Priority: HIGH for action security_group_rules [ 911.125708] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a4f425c-32f7-4ed6-9a9d-94fde134a425 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.125878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a4f425c-32f7-4ed6-9a9d-94fde134a425" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.125962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a4f425c-32f7-4ed6-9a9d-94fde134a425" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.126345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a4f425c-32f7-4ed6-9a9d-94fde134a425" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.126458] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a4f425c-32f7-4ed6-9a9d-94fde134a425',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.128356] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ebe8c18-10e1-409f-82d4-0340ed451137 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.128525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.128594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.128766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.128883] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ebe8c18-10e1-409f-82d4-0340ed451137',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.130395] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.130395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.130395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.130619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.130738] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.135382] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.135615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.135615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.135838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.135960] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.137385] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.137545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.137952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.137952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.138109] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.139221] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b46602ad-46c7-4516-bebe-9e57e30f5e16 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.139509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.139509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.139630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.139665] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b46602ad-46c7-4516-bebe-9e57e30f5e16',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.141214] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.141389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.141389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.141631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.141840] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.143117] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.143233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.143326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.143452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.143519] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.144619] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aea93861-5728-4289-9609-763ed4d27c02 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.144806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.144806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.144969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.145047] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aea93861-5728-4289-9609-763ed4d27c02',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.146144] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.146338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.146338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.146489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.146489] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6607a38e-6205-4531-b5e6-7fd1d3e900ea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.148578] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.148578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.148578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.148578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.148578] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.148578] env[65899]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 911.148981] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.149057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.149208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.149489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.149489] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.150388] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.150388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.150388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.150721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.150721] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.151642] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78fc9585-54a3-4e16-8c58-5b307977bb8e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.151779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.151846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.152314] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.152314] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78fc9585-54a3-4e16-8c58-5b307977bb8e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.153012] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.153129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.153194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.153364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.153436] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccb53a98-d213-45f3-8ad2-09830fe9ee60',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.154327] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.154457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.154539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.154747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.154833] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.156163] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58bb0b54-538c-449e-bd48-369e68a81947 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.156318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.156408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.157282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.157282] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58bb0b54-538c-449e-bd48-369e68a81947',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.157985] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.157985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.157985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.158405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.158405] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.159100] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b1b07c8-6f18-4d08-b906-df258186de4a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.159747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.159829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.159977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.160074] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b1b07c8-6f18-4d08-b906-df258186de4a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.161060] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-974c962f-0ed5-4445-b566-b0cc5bb30621 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.161303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.161385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.161980] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.162097] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('974c962f-0ed5-4445-b566-b0cc5bb30621',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.162993] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-327722f8-ce30-47cb-9d43-141fd71e0315 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.163134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.163191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.163334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.163408] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('327722f8-ce30-47cb-9d43-141fd71e0315',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.163683] env[65899]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 911.168822] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a4f425c-32f7-4ed6-9a9d-94fde134a425 [ 911.168822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.168822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.168822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.169205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.169205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.169205] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a4f425c-32f7-4ed6-9a9d-94fde134a425 already deleted. [ 911.169205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a4f425c-32f7-4ed6-9a9d-94fde134a425" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.171643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.171643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.171803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.172245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.172245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.193937] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 in Status: IN_PROGRESS for 2s [ 911.200495] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.200699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.200699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.200930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.231031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.231226] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be deleted. [ 911.458197] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.458197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.458197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.458197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.458197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.458197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.697050] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.697217] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.697286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.697501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.711642] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.711964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.712107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.712353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.712577] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.712716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.712791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.712976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.713090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.713192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.713284] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.718961] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.719150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.719356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.719558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.719779] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.719931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.720107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.720334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.720476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.720653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.720789] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.725258] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.725529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.725628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.725897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.726400] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.726473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.726522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.726730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.726892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.726947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.727143] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.728367] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.729023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.729023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.729023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.729023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.729323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.729323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.729437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.729540] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.729643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.729751] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.733258] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.733412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.733563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.733780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.733982] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.734131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.734207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.734382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.734493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.734607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.734721] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.743436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.743436] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ebe8c18-10e1-409f-82d4-0340ed451137 is going to be deleted. [ 911.752742] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.755039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.755039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.755039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.755039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.755039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.755039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.755362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.755362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.755475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.755564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.755669] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.770334] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.770527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.770634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.770893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.827893] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.828085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.829031] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.829149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.830591] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.830591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.830853] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.830853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.833009] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.833120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.833950] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.834048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.834976] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.834976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.835649] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.835740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.836469] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.836557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.837446] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.837446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.838058] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 911.838453] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.838687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.839363] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 911.839601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.839688] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 327722f8-ce30-47cb-9d43-141fd71e0315 is going to be deleted. [ 911.840635] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.840849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.895628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.895628] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b46602ad-46c7-4516-bebe-9e57e30f5e16 is going to be deleted. [ 911.896583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.896874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.898687] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.898818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.930492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.930621] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be deleted. [ 911.931676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.932020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.010491] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.010491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.040484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.041398] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b1b07c8-6f18-4d08-b906-df258186de4a is going to be deleted. [ 912.043444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.043444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.094308] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.094492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.135627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.135766] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78fc9585-54a3-4e16-8c58-5b307977bb8e is going to be deleted. [ 912.144665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.144665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.150388] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.150616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.171896] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.172169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.199836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.200083] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be deleted. [ 912.201389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.201485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.216736] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.243790] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.244148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.244148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.244241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.244516] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.244706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.244706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.244881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.245028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.245140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.245370] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.245516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.245568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.246425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.246425] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.246425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.246425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.246425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.246425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.246425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.246782] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.252878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.254029] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aea93861-5728-4289-9609-763ed4d27c02 is going to be deleted. [ 912.254726] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.255830] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.255982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.256064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.256349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.256556] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.256686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.256749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.256970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.257095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.257191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.257344] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.257461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.257529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.257678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.257828] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.257922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.257979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.260683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.260807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.260910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.261022] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.262145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.262242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.265476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.265476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.266178] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d97c0b7d-58d1-4baf-97be-f3a035518398: rpc.has_security_group_logging(os_id): False [ 912.272312] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.272472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.272472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.276804] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.276804] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.276804] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.276804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.276804] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.330372] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.330372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.330372] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.330372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.337208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.337364] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6607a38e-6205-4531-b5e6-7fd1d3e900ea is going to be deleted. [ 912.340118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.340118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.390028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.390028] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58bb0b54-538c-449e-bd48-369e68a81947 is going to be deleted. [ 912.390028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.390028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.427502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.427678] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccb53a98-d213-45f3-8ad2-09830fe9ee60 is going to be deleted. [ 912.428693] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.428905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.434623] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.434746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.490500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.490672] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be deleted. [ 912.491799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.492044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.516635] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.516635] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.528342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.528342] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 974c962f-0ed5-4445-b566-b0cc5bb30621 is going to be deleted. [ 912.528509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.528732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.528802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.528922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ebe8c18-10e1-409f-82d4-0340ed451137" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.529134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.529499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.529499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.529499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-327722f8-ce30-47cb-9d43-141fd71e0315" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.530465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.530465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.530465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.530465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b46602ad-46c7-4516-bebe-9e57e30f5e16" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.530730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.530730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.530827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.530980] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.531186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.531186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.531295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.531355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b1b07c8-6f18-4d08-b906-df258186de4a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.534351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.534351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.534351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.534351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78fc9585-54a3-4e16-8c58-5b307977bb8e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.534351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.534351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.568605] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.568767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.579609] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.579609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.589443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.589443] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.589443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.589443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.589443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.589443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.589443] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 912.590080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.590276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.590358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.590472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.590606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.590746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.590815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.590918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aea93861-5728-4289-9609-763ed4d27c02" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.591093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.591286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.591362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.591472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6607a38e-6205-4531-b5e6-7fd1d3e900ea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.591582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.591786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.591786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.591926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccb53a98-d213-45f3-8ad2-09830fe9ee60" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.592550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.592711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.592784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.592916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58bb0b54-538c-449e-bd48-369e68a81947" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.637914] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.637914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.637914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.637914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.638132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.638132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.645089] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.645089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.645269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.645832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.645832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.645832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-974c962f-0ed5-4445-b566-b0cc5bb30621" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.720611] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83bf7771-fa03-4285-8780-9b265ead5b3d: rpc.has_security_group_logging(os_id): False [ 912.758756] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.759050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.759050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.759293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.766470] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 743c5a69-4fa0-4875-ab4b-14b45b31c03c: rpc.has_security_group_logging(os_id): False [ 912.766470] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631: rpc.has_security_group_logging(os_id): False [ 912.779093] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 085ff348-1812-4078-9ad5-3958496f698b: rpc.has_security_group_logging(os_id): False [ 912.780772] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc14a464-84a2-4f30-88ae-7b0da98e4e95: rpc.has_security_group_logging(os_id): False [ 912.811918] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.812719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.816040] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.816040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.816444] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.816543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.818202] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.818202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.818202] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.818746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.824240] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 912.824970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.825296] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.825401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.825401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.825608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.825682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.825814] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d is going to be updated. [ 912.826971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.827178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.827322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.828413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.828587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.852554] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 912.876588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.877029] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.877205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.877297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.877568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.877687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.877999] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.878439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.878546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.878786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.879417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.879417] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.879976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.879976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.879976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.879976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.880113] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 912.881705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.881949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.914870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.915332] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.915492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.915561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.915814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.915924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.918502] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be updated. [ 912.920155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.920385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.938169] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.938372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.968621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.968780] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.968956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.969046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.969186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.969269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.969500] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.970143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.970143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.970143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.970143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.970143] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.970143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.970143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.970416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.970416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.970416] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085ff348-1812-4078-9ad5-3958496f698b is going to be updated. [ 912.971534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.972312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.018174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.018517] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.018664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.018723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.019016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.019163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.019535] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.019654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.019716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.019911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.019995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.020246] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.020370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.020455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.020671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.020754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.020840] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 913.023421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.023421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.023421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.040303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.040303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.040303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.040303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.040303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.051357] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.051587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.052319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.052520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.052666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.058218] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: IN_PROGRESS for 2s [ 913.069510] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 913.090930] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: IN_PROGRESS for 2s [ 913.097216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.097418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.097418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.097640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.097776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.121073] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: IN_PROGRESS for 2s [ 913.156557] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.156557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.156835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.156835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.156964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.196448] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 913.206097] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 in Status: SUCCESS [ 913.206431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.518658] env[65899]: INFO networking_nsxv3.common.synchronization [req-e80339ab-d56c-4a44-aa42-af6b26beaa38 req-86e6dada-6de1-42d6-b911-222d7bf3cd74 tempest-TenantUsagesTestJSON-519081158 tempest-TenantUsagesTestJSON-519081158-project-member] Enqueued Resource ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 with Priority: HIGHEST for action security_group_members [ 913.520191] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 with Priority: HIGHEST for action security_group_members [ 913.520191] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.520191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.520191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.520191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.520191] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.520191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.520672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.520672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.520672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.520672] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbbd5a6a-d11b-47e8-a835-6b824a5963a5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.023298] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.023455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.023455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.023698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.049019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.049019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.049019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.049019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.049019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.049019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.049019] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 is going to be updated. [ 914.080660] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.080660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.080660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.080660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.080660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.090795] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 in Status: IN_PROGRESS for 2s [ 914.112241] env[65899]: INFO networking_nsxv3.common.synchronization [None req-8d20633d-5642-4f84-bb0d-72c34f69a76a None None] Enqueued Resource ID: d4caa64a-1694-48af-9c30-93c8a607e033 with Priority: HIGHEST for action port [ 914.113573] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4caa64a-1694-48af-9c30-93c8a607e033 with Priority: HIGHEST for action port [ 914.113897] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4caa64a-1694-48af-9c30-93c8a607e033 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.114086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4caa64a-1694-48af-9c30-93c8a607e033" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.114086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4caa64a-1694-48af-9c30-93c8a607e033" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.116073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4caa64a-1694-48af-9c30-93c8a607e033" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.116073] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4caa64a-1694-48af-9c30-93c8a607e033',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.616388] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4caa64a-1694-48af-9c30-93c8a607e033 [ 914.616631] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.616773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.616838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.617070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.617160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.617258] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4caa64a-1694-48af-9c30-93c8a607e033 already deleted. [ 914.617345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4caa64a-1694-48af-9c30-93c8a607e033" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.869432] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 914.869661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.075169] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: SUCCESS [ 915.075169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.081370] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 915.081609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.101610] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: SUCCESS [ 915.102117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.133736] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: SUCCESS [ 915.136338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.210462] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 915.210648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.301876] env[65899]: INFO networking_nsxv3.common.synchronization [None req-59924c34-ee74-4c00-840c-e630a58cb42c None None] Enqueued Resource ID: deece4e1-c019-4522-aa43-d07e5ed10274 with Priority: HIGHEST for action port [ 915.302441] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deece4e1-c019-4522-aa43-d07e5ed10274 with Priority: HIGHEST for action port [ 915.303076] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-deece4e1-c019-4522-aa43-d07e5ed10274 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.303687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deece4e1-c019-4522-aa43-d07e5ed10274" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.303687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deece4e1-c019-4522-aa43-d07e5ed10274" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.303687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deece4e1-c019-4522-aa43-d07e5ed10274" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.303828] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deece4e1-c019-4522-aa43-d07e5ed10274',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.806644] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deece4e1-c019-4522-aa43-d07e5ed10274 [ 915.806915] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.807079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.807153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.807380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.807461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.807549] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deece4e1-c019-4522-aa43-d07e5ed10274 already deleted. [ 915.807631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deece4e1-c019-4522-aa43-d07e5ed10274" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.139352] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 in Status: SUCCESS [ 916.139690] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbbd5a6a-d11b-47e8-a835-6b824a5963a5 deletion is rescheduled due to dependency. [ 916.144023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbbd5a6a-d11b-47e8-a835-6b824a5963a5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.209034] env[65899]: INFO networking_nsxv3.common.synchronization [req-492a3e15-9845-402d-8d72-5000065c717b req-f0a274c8-3180-43db-8f1c-3cc5a19dd264 tempest-InstanceActionsNegativeTestJSON-899149509 tempest-InstanceActionsNegativeTestJSON-899149509-project-member] Enqueued Resource ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 with Priority: HIGHEST for action security_group_members [ 916.209616] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 with Priority: HIGHEST for action security_group_members [ 916.209928] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea1a19d6-ac31-4e61-b250-037c90dc02d6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.210342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.210435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.210644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.210879] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.210990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.211066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.211224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.211304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.211432] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea1a19d6-ac31-4e61-b250-037c90dc02d6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.714951] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.715470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.715470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.715654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.715654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.716915] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.716915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.716915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.716915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.716915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.716915] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 is going to be updated. [ 916.758270] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.758688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.758688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.758880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.758880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.776541] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 in Status: IN_PROGRESS for 2s [ 916.943517] env[65899]: INFO networking_nsxv3.common.synchronization [req-76a2c3c5-4ecf-417f-8a9a-d1d7767f1067 req-504d4acf-4a94-4713-ac98-01b64968b0b8 tempest-ServerDiagnosticsTest-1854772864 tempest-ServerDiagnosticsTest-1854772864-project-member] Enqueued Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGHEST for action security_group_members [ 916.944507] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGHEST for action security_group_members [ 916.945280] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.945475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.945529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.945757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.945929] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.946044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.946105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.948018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.948018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.948018] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.139525] env[65899]: INFO networking_nsxv3.common.synchronization [req-fe6092ed-4c1b-430b-8ff5-86a78f7a960b req-26f3e90e-fa42-4498-90cd-c5f67a6b51cf tempest-ListServerFiltersTestJSON-273501370 tempest-ListServerFiltersTestJSON-273501370-project-member] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 917.142613] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 917.142613] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.142613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.142613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.142613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.142613] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.142613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.142613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.142613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.142613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.142613] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.409593] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-409 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.409811] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.409964] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.410274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.410570] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.410733] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.410866] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.411157] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.411334] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.411581] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.411731] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.411893] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.412193] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.412271] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.412423] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.412583] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.434811] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.434811] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.434811] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.434811] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-409" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.434811] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-0265d2d9-c22e-499c-83bf-5d6bc32481e0 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.434811] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-0265d2d9-c22e-499c-83bf-5d6bc32481e0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.434811] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-0265d2d9-c22e-499c-83bf-5d6bc32481e0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.434811] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-0265d2d9-c22e-499c-83bf-5d6bc32481e0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.434811] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0265d2d9-c22e-499c-83bf-5d6bc32481e0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.448952] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.449288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.449288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.449876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.453387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.453776] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.453923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.454030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.454226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.454280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.454366] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 already deleted. [ 917.454455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.644386] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.647326] env[65899]: INFO networking_nsxv3.common.synchronization [None req-40ff6b3e-0bf0-4723-9037-3388f31934aa None None] Enqueued Resource ID: 6ea9ccb5-917b-4eb5-a1e0-df707586825e with Priority: HIGHEST for action port [ 917.647326] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea9ccb5-917b-4eb5-a1e0-df707586825e with Priority: HIGHEST for action port [ 917.647326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ea9ccb5-917b-4eb5-a1e0-df707586825e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.647326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ea9ccb5-917b-4eb5-a1e0-df707586825e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.647326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ea9ccb5-917b-4eb5-a1e0-df707586825e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.647846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ea9ccb5-917b-4eb5-a1e0-df707586825e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.647846] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ea9ccb5-917b-4eb5-a1e0-df707586825e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.937741] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.937970] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.938112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.938466] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.938726] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.938952] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 0265d2d9-c22e-499c-83bf-5d6bc32481e0 not found, creating... [ 917.939309] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.939489] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.939741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.940025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.940176] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.940533] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.940708] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.940853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.941178] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.941216] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.941394] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 0265d2d9-c22e-499c-83bf-5d6bc32481e0 is going to be created. [ 917.963115] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.963496] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.963723] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.964141] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.964518] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.964829] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-0265d2d9-c22e-499c-83bf-5d6bc32481e0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.012821] env[65899]: INFO networking_nsxv3.common.synchronization [req-78b1775e-378b-4002-9fe3-dc4593c4f728 req-ecb595b0-4d97-4eaa-9bab-fc8e25fc8d48 tempest-ListServersNegativeTestJSON-1875250317 tempest-ListServersNegativeTestJSON-1875250317-project-member] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 918.013189] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 918.013614] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.013788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.013927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.014212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.014429] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.014580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.014668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.014874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.014999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.015146] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.150449] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.151485] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ea9ccb5-917b-4eb5-a1e0-df707586825e [ 918.151697] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.151840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.151934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.152213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.152298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.152410] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ea9ccb5-917b-4eb5-a1e0-df707586825e already deleted. [ 918.152410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ea9ccb5-917b-4eb5-a1e0-df707586825e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.494603] env[65899]: INFO networking_nsxv3.common.synchronization [req-a3453a35-207e-4fb3-b029-77485118d227 req-cc41a1fb-4066-45d9-9567-deb2bd8a07cd tempest-ListServersNegativeTestJSON-1875250317 tempest-ListServersNegativeTestJSON-1875250317-project-member] Enqueued Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 918.495024] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a with Priority: HIGHEST for action security_group_members [ 918.495319] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.495418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.518074] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.653168] env[65899]: INFO networking_nsxv3.common.synchronization [req-76a2c3c5-4ecf-417f-8a9a-d1d7767f1067 req-4f1bd67d-10cb-4885-b540-48f42226f4d9 service nova] Enqueued Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGHEST for action security_group_rules [ 918.653382] env[65899]: INFO networking_nsxv3.common.synchronization [req-76a2c3c5-4ecf-417f-8a9a-d1d7767f1067 req-4f1bd67d-10cb-4885-b540-48f42226f4d9 service nova] Enqueued Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGHEST for action security_group_members [ 918.653550] env[65899]: INFO networking_nsxv3.common.synchronization [req-76a2c3c5-4ecf-417f-8a9a-d1d7767f1067 req-4f1bd67d-10cb-4885-b540-48f42226f4d9 service nova] Enqueued Resource ID: 0265d2d9-c22e-499c-83bf-5d6bc32481e0 with Priority: HIGHEST for action port [ 918.653996] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.654244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.654244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.654688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.654688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.654688] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 918.656375] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGHEST for action security_group_rules [ 918.656646] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGHEST for action security_group_members [ 918.656795] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0265d2d9-c22e-499c-83bf-5d6bc32481e0 with Priority: HIGHEST for action port [ 918.657476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.657476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.657476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.657659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.657659] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.658675] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.658829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.658919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.659117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.659627] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.659765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.659854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.660045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.660231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.660341] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.661360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-0265d2d9-c22e-499c-83bf-5d6bc32481e0 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.661502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0265d2d9-c22e-499c-83bf-5d6bc32481e0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.661594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0265d2d9-c22e-499c-83bf-5d6bc32481e0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.661806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0265d2d9-c22e-499c-83bf-5d6bc32481e0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.662052] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0265d2d9-c22e-499c-83bf-5d6bc32481e0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.692154] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.692154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.692154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.692154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.692154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.701525] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 918.789430] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 in Status: SUCCESS [ 918.789732] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea1a19d6-ac31-4e61-b250-037c90dc02d6 deletion is rescheduled due to dependency. [ 918.789943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea1a19d6-ac31-4e61-b250-037c90dc02d6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.021937] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.163476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.163802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.164088] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.165531] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0265d2d9-c22e-499c-83bf-5d6bc32481e0 with status ACTIVE [ 919.165823] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.165976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.166076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.166365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.166472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.166699] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.166827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.166909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.167422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.168011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.168011] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.168011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.168167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.168250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.168348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.168461] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0265d2d9-c22e-499c-83bf-5d6bc32481e0 is going to be updated. [ 919.190997] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.190997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.190997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.190997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.190997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.191317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0265d2d9-c22e-499c-83bf-5d6bc32481e0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.526027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.526027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.526027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.526027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.526027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.526027] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 919.556082] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.556082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.556082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.556082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.556082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.566463] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 919.671671] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.174927] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.175271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.175271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.175439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.175439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.175543] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 is going to be created. [ 920.198932] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.199092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.199160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.199364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.199525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.209187] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 in Status: UNINITIALIZED for 2s [ 920.712642] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 920.712911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.578315] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 921.578572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.578660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.579802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.579802] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.579802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.579802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.579802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.579802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.579802] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbdddd19-b5d8-4409-9731-8dacfc9c1c1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.082559] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.082717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.082912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.083007] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.109394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.109648] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.109770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.109837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.110065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.110149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.110561] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a is going to be updated. [ 922.143893] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.143893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.143893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.143893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.143893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.155471] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: IN_PROGRESS for 2s [ 922.220114] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 in Status: SUCCESS [ 922.220338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.220515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.220739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.220937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.221100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.221152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.221301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.221381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.221464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.221567] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.723651] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.724146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.724146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.724236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.724429] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.724553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.724630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.724823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.724933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.725082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.725273] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.725386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.725455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.725630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.725790] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.725899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.725962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.726221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.726296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.726375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.726464] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.229311] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61: rpc.has_security_group_logging(os_id): False [ 923.247476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.247625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.247694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.247912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.248015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.248245] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.248417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.248481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.248652] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.248778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.248960] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.249028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.249062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.249193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.249278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.249441] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.249529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.249589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.249720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.249791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.249872] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 is going to be created. [ 923.311857] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.312032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.312185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.312282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.312466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.325645] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 in Status: IN_PROGRESS for 2s [ 923.657793] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 923.657910] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 924.168178] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a in Status: SUCCESS [ 924.168739] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbdddd19-b5d8-4409-9731-8dacfc9c1c1a deletion is rescheduled due to dependency. [ 924.169077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbdddd19-b5d8-4409-9731-8dacfc9c1c1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.339291] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 in Status: SUCCESS [ 925.339599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.658513] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 928.658513] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 928.850690] env[65899]: INFO networking_nsxv3.common.synchronization [req-904e6da3-a017-46b1-899f-983336de06b0 req-c33efc36-5175-4b99-8632-8c53b5a6eb57 tempest-ServerDiagnosticsTest-1854772864 tempest-ServerDiagnosticsTest-1854772864-project-member] Enqueued Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGHEST for action security_group_members [ 928.851423] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGHEST for action security_group_members [ 928.851755] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.851991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.852104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.852327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.852552] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.852666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.852750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.852916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.853025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.853100] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.025900] env[65899]: INFO networking_nsxv3.common.synchronization [req-eb46eacf-0edf-4735-87ac-c13ab7c80933 req-e654a884-4d5f-4d6c-9f0a-49165862a5b3 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 929.026445] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 929.026792] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.026929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.027068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.027281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.027431] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.027531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.027586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.027729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.027809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.027898] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.330974] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.331310] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.331520] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.331894] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.332247] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.332419] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.332533] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.332794] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.332952] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.333175] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.333331] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.333455] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.333559] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.333667] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.333767] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.333892] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.356182] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.356182] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 929.356182] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.356182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.356182] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-aac308c3-18c7-4ed9-96dd-b3ca15793068 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.356458] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-aac308c3-18c7-4ed9-96dd-b3ca15793068" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.356548] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-aac308c3-18c7-4ed9-96dd-b3ca15793068" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.356875] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-aac308c3-18c7-4ed9-96dd-b3ca15793068" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.357043] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac308c3-18c7-4ed9-96dd-b3ca15793068',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.358048] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.358251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.358485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.358485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.358556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.359201] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.359201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.359201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.359201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.359201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.359431] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 is going to be updated. [ 929.389284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.389574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.389662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.389875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.390119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.400482] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 in Status: IN_PROGRESS for 2s [ 929.530617] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.530617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.530617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.530617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.530832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.530970] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.531061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.531141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.531318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.531465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.531526] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be deleted. [ 929.568502] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.568645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.568706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.568914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.569011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.569114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.861315] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.861716] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.861716] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.861954] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.862290] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.862608] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port aac308c3-18c7-4ed9-96dd-b3ca15793068 not found, creating... [ 929.863046] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.863322] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.863543] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.863927] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.864301] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.864744] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.865045] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.865284] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.865643] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.865897] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.866167] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: aac308c3-18c7-4ed9-96dd-b3ca15793068 is going to be created. [ 929.889862] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.890238] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.890469] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.890885] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.891395] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.891737] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-aac308c3-18c7-4ed9-96dd-b3ca15793068" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.597318] env[65899]: INFO networking_nsxv3.common.synchronization [req-eb46eacf-0edf-4735-87ac-c13ab7c80933 req-22f4b708-7f8f-4c74-a372-894767f3c871 service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 930.597318] env[65899]: INFO networking_nsxv3.common.synchronization [req-eb46eacf-0edf-4735-87ac-c13ab7c80933 req-22f4b708-7f8f-4c74-a372-894767f3c871 service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 930.597318] env[65899]: INFO networking_nsxv3.common.synchronization [req-eb46eacf-0edf-4735-87ac-c13ab7c80933 req-22f4b708-7f8f-4c74-a372-894767f3c871 service nova] Enqueued Resource ID: aac308c3-18c7-4ed9-96dd-b3ca15793068 with Priority: HIGHEST for action port [ 930.598277] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 930.598277] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 930.598480] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aac308c3-18c7-4ed9-96dd-b3ca15793068 with Priority: HIGHEST for action port [ 930.598650] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.598777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.598842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.600506] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.600506] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.601431] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.601553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.601614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.602429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.602619] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.602730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.602792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.603100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.603100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.603235] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.604958] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-aac308c3-18c7-4ed9-96dd-b3ca15793068 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.605822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aac308c3-18c7-4ed9-96dd-b3ca15793068" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.605822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aac308c3-18c7-4ed9-96dd-b3ca15793068" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.605822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aac308c3-18c7-4ed9-96dd-b3ca15793068" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.605822] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aac308c3-18c7-4ed9-96dd-b3ca15793068',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.107121] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.108457] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.108457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.108781] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aac308c3-18c7-4ed9-96dd-b3ca15793068 with status ACTIVE [ 931.110043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.110043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.110043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.110043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.110043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.110043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.110385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.110385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.110385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.110569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.110635] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.110692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.110731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.110867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.110942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.111048] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aac308c3-18c7-4ed9-96dd-b3ca15793068 is going to be updated. [ 931.132831] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.133105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.133105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.133234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.133420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.133587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aac308c3-18c7-4ed9-96dd-b3ca15793068" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.412679] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 in Status: SUCCESS [ 931.412864] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 deletion is rescheduled due to dependency. [ 931.412977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.609762] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.665326] env[65899]: INFO networking_nsxv3.common.synchronization [req-0a2757dd-0e16-450f-95a2-a87a2883be58 req-6b8b3c4e-acfa-45ac-9ab8-4239000f6bf0 tempest-AttachVolumeTestJSON-2123047702 tempest-AttachVolumeTestJSON-2123047702-project-member] Enqueued Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_members [ 931.666015] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_members [ 931.666432] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.666604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.666696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.666966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.667174] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.667301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.667421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.667564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.667705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.667827] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.033792] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.033967] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-586" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.034144] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-586" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.034465] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-586" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.034726] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.034880] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.034992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.035275] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.035359] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.035563] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.035674] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.035780] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.035885] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.035988] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.036113] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.036591] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.059860] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.060230] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.060554] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.060836] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-586" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.061241] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.061477] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.061644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.062127] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.062610] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf2f7bb5-ee9c-4cbf-b898-51a211f762f0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.113702] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.114326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.114326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.114514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.114581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.118025] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be created. [ 932.140337] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.141318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.141318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.141318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.141318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.150373] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: UNINITIALIZED for 2s [ 932.170035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.170245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.170345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.170676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.170776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.171766] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.171766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.171766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.171766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.171766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.171766] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 already deleted. [ 932.172030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.565389] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.565625] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.565756] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.566069] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.566239] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.566396] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port bf2f7bb5-ee9c-4cbf-b898-51a211f762f0 not found, creating... [ 932.566665] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.566818] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.566929] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.567180] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.567326] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.567596] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.567746] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.567855] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.568071] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.568200] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.568331] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: bf2f7bb5-ee9c-4cbf-b898-51a211f762f0 is going to be created. [ 932.589383] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.589604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.589768] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.590586] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.590586] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.590586] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.290358] env[65899]: INFO networking_nsxv3.common.synchronization [req-0a2757dd-0e16-450f-95a2-a87a2883be58 req-60aeceef-7f79-4785-a45c-5a50e92108cf service nova] Enqueued Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_rules [ 933.290358] env[65899]: INFO networking_nsxv3.common.synchronization [req-0a2757dd-0e16-450f-95a2-a87a2883be58 req-60aeceef-7f79-4785-a45c-5a50e92108cf service nova] Enqueued Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_members [ 933.290358] env[65899]: INFO networking_nsxv3.common.synchronization [req-0a2757dd-0e16-450f-95a2-a87a2883be58 req-60aeceef-7f79-4785-a45c-5a50e92108cf service nova] Enqueued Resource ID: bf2f7bb5-ee9c-4cbf-b898-51a211f762f0 with Priority: HIGHEST for action port [ 933.290358] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_rules [ 933.290358] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_members [ 933.290358] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf2f7bb5-ee9c-4cbf-b898-51a211f762f0 with Priority: HIGHEST for action port [ 933.290358] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.290358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.290358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.290358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.290358] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.292189] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.292399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.292399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.292561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.292677] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.292873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.292931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.293097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.293174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.293258] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.294068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.294427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.294427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.295019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.295019] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf2f7bb5-ee9c-4cbf-b898-51a211f762f0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.797424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.797424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.797424] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.798130] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf2f7bb5-ee9c-4cbf-b898-51a211f762f0 with status ACTIVE [ 933.798130] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.798130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.798130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.798130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.798323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.800046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.800046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.800046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.800046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.800046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.800046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.800046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.802093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.802093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.802093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.802093] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf2f7bb5-ee9c-4cbf-b898-51a211f762f0 is going to be updated. [ 933.824791] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.824964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.824964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.825194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.825331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.825483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf2f7bb5-ee9c-4cbf-b898-51a211f762f0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.163731] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 934.164488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.164488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.164755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.164867] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.165208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.165208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.165367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.165474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.165564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.165677] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.306378] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.569297] env[65899]: INFO networking_nsxv3.common.synchronization [req-a3289849-9fb1-4630-81cb-1acfdab54b91 req-d9ba98e0-6273-472c-b859-e179cb2dc170 tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 934.569297] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 934.571106] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.571424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.571588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.571916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.574670] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.574670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.574670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.574670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.574670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.574670] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.669508] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.669812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.669812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.670096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.671131] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.671131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.671131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.671131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.671131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.671131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.671131] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.671131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.671131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.671660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.671660] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.671660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.671660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.671660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.671976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.671976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.671976] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.810307] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.810307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.810307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.810307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.810307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.810307] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 is going to be created. [ 934.834552] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.835208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.835283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.835515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.835701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.854282] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 in Status: UNINITIALIZED for 2s [ 935.079390] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.079579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.079645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.079872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.079978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.080216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.080821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.080821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.080821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.080821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.080821] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 already deleted. [ 935.080821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.143137] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.143337] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.143464] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.143812] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.144710] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.144953] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.145418] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.145503] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.145609] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.146436] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.146436] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.146436] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.146436] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.146436] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.146436] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.146436] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.166689] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.166689] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.166689] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.166689] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.167140] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.167325] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.167496] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.167856] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.167986] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84c03c5e-325e-4ae7-ac41-d5b294e5a01e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.176771] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b: rpc.has_security_group_logging(os_id): False [ 935.197244] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.197376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.197376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.197680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.197811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.198579] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.198579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.198579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.198579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.198579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.198579] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.198579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.198982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.198982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.198982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.199097] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.199097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.199185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.199282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.199349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.199429] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be created. [ 935.269524] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.269713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.269819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.270103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.270379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.287038] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 935.670486] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.670949] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.670949] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.671285] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.671285] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.671398] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 84c03c5e-325e-4ae7-ac41-d5b294e5a01e not found, creating... [ 935.671614] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.671774] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.671887] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.672162] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.672330] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.672624] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.672776] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.672889] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.673120] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.673251] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.673388] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 84c03c5e-325e-4ae7-ac41-d5b294e5a01e is going to be created. [ 935.729325] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.729549] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.729677] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.729992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.730263] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.730587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.407043] env[65899]: INFO networking_nsxv3.common.synchronization [req-a3289849-9fb1-4630-81cb-1acfdab54b91 req-abbf12f0-5d0f-42d7-8d34-ffc8cfb9ee4f service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 936.407264] env[65899]: INFO networking_nsxv3.common.synchronization [req-a3289849-9fb1-4630-81cb-1acfdab54b91 req-abbf12f0-5d0f-42d7-8d34-ffc8cfb9ee4f service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 936.407412] env[65899]: INFO networking_nsxv3.common.synchronization [req-a3289849-9fb1-4630-81cb-1acfdab54b91 req-abbf12f0-5d0f-42d7-8d34-ffc8cfb9ee4f service nova] Enqueued Resource ID: 84c03c5e-325e-4ae7-ac41-d5b294e5a01e with Priority: HIGHEST for action port [ 936.407919] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 936.408112] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 936.408571] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84c03c5e-325e-4ae7-ac41-d5b294e5a01e with Priority: HIGHEST for action port [ 936.408571] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.408828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.408828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.408940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.409885] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.409957] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.410048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.410158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.410672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.410858] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.410995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.411096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.411274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.411380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.411489] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.412265] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.412409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.412496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.412671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.412768] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84c03c5e-325e-4ae7-ac41-d5b294e5a01e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.880121] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 in Status: SUCCESS [ 936.880544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.880607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.880826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.881484] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.881653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.881740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.881950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.882158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.882242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.882334] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.914978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.915215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.915353] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.918834] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84c03c5e-325e-4ae7-ac41-d5b294e5a01e with status ACTIVE [ 936.919077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.919212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.919281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.919497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.919623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.919819] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.920087] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.920087] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.925382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.925382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.925382] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.925382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.925382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.925382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.925382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.925382] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84c03c5e-325e-4ae7-ac41-d5b294e5a01e is going to be updated. [ 936.961712] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.961941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.961988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.962833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.962833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.962833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84c03c5e-325e-4ae7-ac41-d5b294e5a01e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.293551] env[65899]: INFO networking_nsxv3.common.synchronization [req-04fb0474-43b1-48d3-9b72-8429525abbf8 req-ad1d9424-60dd-44dd-bc45-88d7882344ed tempest-ServersWithSpecificFlavorTestJSON-353865173 tempest-ServersWithSpecificFlavorTestJSON-353865173-project-member] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 937.294368] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 937.294593] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.294973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.294973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.294973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.295186] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.295242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.295502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.295502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.295686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.295686] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.297442] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 937.297529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.386430] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.429753] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.678403] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-739 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.678403] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-739" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.678594] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-739" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.679435] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-739" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.679435] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.679435] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.679634] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.679808] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.679995] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.680267] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.680418] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.680560] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.680700] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.680847] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.681871] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.681871] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.700577] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.700745] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.700882] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.701063] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-739" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.701389] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-f6f425b6-11f9-4669-a94b-7b06c74ce836 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.701547] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-f6f425b6-11f9-4669-a94b-7b06c74ce836" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.701661] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-f6f425b6-11f9-4669-a94b-7b06c74ce836" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.701986] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-f6f425b6-11f9-4669-a94b-7b06c74ce836" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.702138] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f425b6-11f9-4669-a94b-7b06c74ce836',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.799605] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.799809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.800753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.800753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.800753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.801440] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.801440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.801440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.801723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.801990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.802113] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be deleted. [ 937.840291] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.840488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.840544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.840788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.840980] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.841084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.888692] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2904b768-7fb4-4263-a1a8-2deb76da7f25: rpc.has_security_group_logging(os_id): False [ 937.907862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.908099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.908099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.908834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.908834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.908834] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.908834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.909030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.909479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.909479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.909479] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 is going to be created. [ 937.933964] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.934856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.934856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.934856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.934856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.934856] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be created. [ 937.972828] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.972987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.972987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.973336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.973336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.985837] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: UNINITIALIZED for 2s [ 937.989026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.989202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.989202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.989395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.989852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.003936] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 in Status: IN_PROGRESS for 2s [ 938.205262] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.205499] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.205624] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.205907] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.206109] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.206298] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port f6f425b6-11f9-4669-a94b-7b06c74ce836 not found, creating... [ 938.206595] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.206747] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.206859] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.207104] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.207243] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.207518] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.207667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.207806] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.208058] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.208221] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.208391] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: f6f425b6-11f9-4669-a94b-7b06c74ce836 is going to be created. [ 938.229857] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.230107] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.230187] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.230801] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.230801] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.230953] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-f6f425b6-11f9-4669-a94b-7b06c74ce836" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.051160] env[65899]: INFO networking_nsxv3.common.synchronization [req-04fb0474-43b1-48d3-9b72-8429525abbf8 req-d6519e18-b985-4e31-b3f7-12c22fa222cf service nova] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_rules [ 939.051594] env[65899]: INFO networking_nsxv3.common.synchronization [req-04fb0474-43b1-48d3-9b72-8429525abbf8 req-d6519e18-b985-4e31-b3f7-12c22fa222cf service nova] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 939.051594] env[65899]: INFO networking_nsxv3.common.synchronization [req-04fb0474-43b1-48d3-9b72-8429525abbf8 req-d6519e18-b985-4e31-b3f7-12c22fa222cf service nova] Enqueued Resource ID: f6f425b6-11f9-4669-a94b-7b06c74ce836 with Priority: HIGHEST for action port [ 939.051840] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_rules [ 939.051976] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 939.052198] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f425b6-11f9-4669-a94b-7b06c74ce836 with Priority: HIGHEST for action port [ 939.052889] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.053033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.053142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.053443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.053443] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.054342] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.054467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.054558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.054737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.054901] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.055011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.055070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.055824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.055824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.055824] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.056720] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6f425b6-11f9-4669-a94b-7b06c74ce836 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.056720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6f425b6-11f9-4669-a94b-7b06c74ce836" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.056720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6f425b6-11f9-4669-a94b-7b06c74ce836" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.056967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6f425b6-11f9-4669-a94b-7b06c74ce836" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.056967] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f425b6-11f9-4669-a94b-7b06c74ce836',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.558803] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.559178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.559473] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.560400] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6f425b6-11f9-4669-a94b-7b06c74ce836 with status ACTIVE [ 939.560593] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.560726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.560800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.561015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.561105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.561350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.561463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.561525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.561677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.561754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.561928] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.562358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.562470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.562625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.562701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.562798] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6f425b6-11f9-4669-a94b-7b06c74ce836 is going to be updated. [ 939.586935] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.586935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.586935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.587228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.587228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.587426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6f425b6-11f9-4669-a94b-7b06c74ce836" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.997248] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 939.997554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.997737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.998313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.998313] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.998313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.998497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.998497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.998649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.998649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.998719] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.017736] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 in Status: SUCCESS [ 940.017959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.064684] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.501582] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.501797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.501872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.502122] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.502319] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.502422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.502495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.502632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.503188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.503188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.503188] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.503188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.503188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.503363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.503488] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.503624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.503624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.503770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.503839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.503918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.504017] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.568951] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.569146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.569283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.569505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.569594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.569694] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be created. [ 940.595956] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.595956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.595956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.595956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.595956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.604707] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: UNINITIALIZED for 2s [ 940.851256] env[65899]: INFO networking_nsxv3.common.synchronization [None req-19a892de-735f-4d85-8479-cc48208d60db None None] Enqueued Resource ID: 8c5f85b2-675d-4eab-bcc9-db620f2810ed with Priority: HIGHEST for action port [ 940.851872] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5f85b2-675d-4eab-bcc9-db620f2810ed with Priority: HIGHEST for action port [ 940.852445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c5f85b2-675d-4eab-bcc9-db620f2810ed taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.852445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c5f85b2-675d-4eab-bcc9-db620f2810ed" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.852445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c5f85b2-675d-4eab-bcc9-db620f2810ed" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.852761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c5f85b2-675d-4eab-bcc9-db620f2810ed" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.852808] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5f85b2-675d-4eab-bcc9-db620f2810ed',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.006283] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3990baf0-9e24-4b70-8c31-60cf273fe344: rpc.has_security_group_logging(os_id): False [ 941.029693] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.029829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.029903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.034324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.034324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.035374] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.035544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.035588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.035823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.036074] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.036354] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.037099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.037099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.037099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.037099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.037099] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.037377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.037377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.037442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.037530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.037592] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be created. [ 941.111351] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.111739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.111739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.112121] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.113311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.132349] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 941.356696] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c5f85b2-675d-4eab-bcc9-db620f2810ed [ 941.356696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.356696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.356696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.357293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.357293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.357293] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c5f85b2-675d-4eab-bcc9-db620f2810ed already deleted. [ 941.357293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c5f85b2-675d-4eab-bcc9-db620f2810ed" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.618844] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: SUCCESS [ 942.619157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.619244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.619511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.619759] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.619994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.619994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.620545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.620545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.620545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.620545] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.704297] env[65899]: INFO networking_nsxv3.common.synchronization [None req-b18bc9b2-1aaa-4682-a0bb-2e1b01853514 None None] Enqueued Resource ID: db842b0a-9435-4a5c-bdf0-65e88e428d86 with Priority: HIGHEST for action port [ 942.704297] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db842b0a-9435-4a5c-bdf0-65e88e428d86 with Priority: HIGHEST for action port [ 942.704586] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-db842b0a-9435-4a5c-bdf0-65e88e428d86 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.704861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db842b0a-9435-4a5c-bdf0-65e88e428d86" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.705121] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db842b0a-9435-4a5c-bdf0-65e88e428d86" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.705483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db842b0a-9435-4a5c-bdf0-65e88e428d86" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.705677] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db842b0a-9435-4a5c-bdf0-65e88e428d86',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.770555] env[65899]: INFO networking_nsxv3.common.synchronization [None req-e3ffdfb0-537e-4461-a448-d65a18c5a814 tempest-ServersV294TestFqdnHostnames-376433348 tempest-ServersV294TestFqdnHostnames-376433348-project-member] Enqueued Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_rules [ 942.771528] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_rules [ 942.772309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35157e46-cf93-4f9c-919b-4023c4f96551 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.772478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.772552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.772885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.772997] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.887408] env[65899]: INFO networking_nsxv3.common.synchronization [None req-df154f9d-9397-4afa-be08-50e518eb64b4 tempest-ServersV294TestFqdnHostnames-376433348 tempest-ServersV294TestFqdnHostnames-376433348-project-member] Enqueued Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_rules [ 942.887945] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_rules [ 942.888238] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35157e46-cf93-4f9c-919b-4023c4f96551 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.890262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.123074] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.147852] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 943.148256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.208730] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db842b0a-9435-4a5c-bdf0-65e88e428d86 [ 943.210799] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.210799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.210799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.210799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.210799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.210799] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db842b0a-9435-4a5c-bdf0-65e88e428d86 already deleted. [ 943.210799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db842b0a-9435-4a5c-bdf0-65e88e428d86" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.297529] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.297529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.297529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.297778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.297850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.297971] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35157e46-cf93-4f9c-919b-4023c4f96551 already deleted. [ 943.298082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.298247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.298437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.298529] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.353020] env[65899]: INFO networking_nsxv3.common.synchronization [req-fdcca4f1-f746-497c-9b5b-0654570e754a req-a2ea68b3-a2da-4c97-8f6d-0e3ccb9ba6c5 tempest-ServerRescueNegativeTestJSON-46823991 tempest-ServerRescueNegativeTestJSON-46823991-project-member] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 943.353020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 943.353020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.353020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.353020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.353020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.353020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.353020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.353020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.353020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.353020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.353020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.626294] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6305f884-2f1c-4192-bb40-952ed6eaf542: rpc.has_security_group_logging(os_id): False [ 943.646043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.646234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.646271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.646685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.646685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.647977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.647977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.647977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.647977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.647977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.647977] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be created. [ 943.691777] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.692012] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.692192] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.692525] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.692815] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.692979] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.693110] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.693358] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.693509] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.693716] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.693828] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.693936] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.694067] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.694224] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.694369] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.694519] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.707110] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.707110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.707110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.707396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.707446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.715860] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.715860] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.715860] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.715860] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.715860] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-77e64e15-0806-4aba-a4d9-2d98769dbb8d taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.715860] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-77e64e15-0806-4aba-a4d9-2d98769dbb8d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.715860] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-77e64e15-0806-4aba-a4d9-2d98769dbb8d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.716596] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-77e64e15-0806-4aba-a4d9-2d98769dbb8d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.716842] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e64e15-0806-4aba-a4d9-2d98769dbb8d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.720686] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: IN_PROGRESS for 2s [ 943.819862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.819862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.819862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.820139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.820174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.820280] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35157e46-cf93-4f9c-919b-4023c4f96551 already deleted. [ 943.820352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.855201] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.855414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.855501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.855776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.855896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.856174] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.856310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.856401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.856638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.856774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.856893] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 already deleted. [ 943.856934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.219847] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.220120] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.220311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.220646] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.220833] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.220999] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 77e64e15-0806-4aba-a4d9-2d98769dbb8d not found, creating... [ 944.221321] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.221541] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.221678] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.221949] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.222101] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.222414] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.222616] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.222828] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.222986] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.223184] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.223352] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 77e64e15-0806-4aba-a4d9-2d98769dbb8d is going to be created. [ 944.249371] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.249575] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.249702] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.249973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.250408] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.250542] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-77e64e15-0806-4aba-a4d9-2d98769dbb8d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.043415] env[65899]: INFO networking_nsxv3.common.synchronization [req-fdcca4f1-f746-497c-9b5b-0654570e754a req-ae4940b4-0b74-41da-a863-b817dc0369c6 service nova] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_rules [ 945.043757] env[65899]: INFO networking_nsxv3.common.synchronization [req-fdcca4f1-f746-497c-9b5b-0654570e754a req-ae4940b4-0b74-41da-a863-b817dc0369c6 service nova] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 945.043757] env[65899]: INFO networking_nsxv3.common.synchronization [req-fdcca4f1-f746-497c-9b5b-0654570e754a req-ae4940b4-0b74-41da-a863-b817dc0369c6 service nova] Enqueued Resource ID: 77e64e15-0806-4aba-a4d9-2d98769dbb8d with Priority: HIGHEST for action port [ 945.044343] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_rules [ 945.044521] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 945.044697] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e64e15-0806-4aba-a4d9-2d98769dbb8d with Priority: HIGHEST for action port [ 945.044904] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.045450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.045667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.046024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.046280] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.047336] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.047470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.047539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.047724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.047883] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.047985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.048060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.049339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.049339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.049339] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.049816] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-77e64e15-0806-4aba-a4d9-2d98769dbb8d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.050237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77e64e15-0806-4aba-a4d9-2d98769dbb8d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.050237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77e64e15-0806-4aba-a4d9-2d98769dbb8d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.050649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77e64e15-0806-4aba-a4d9-2d98769dbb8d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.050649] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e64e15-0806-4aba-a4d9-2d98769dbb8d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.552639] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77e64e15-0806-4aba-a4d9-2d98769dbb8d with status ACTIVE [ 945.552877] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.552993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.553134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.553288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.553414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.553541] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.553638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.553698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.554384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.554384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.554384] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.554384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.554384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.554637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.554637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.554915] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77e64e15-0806-4aba-a4d9-2d98769dbb8d is going to be updated. [ 945.557863] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.557863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.557863] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.582189] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.582189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.582189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.582189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.582189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.582189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77e64e15-0806-4aba-a4d9-2d98769dbb8d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.740770] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: SUCCESS [ 945.741054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.060487] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.566388] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.566619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.566619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.566835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.566921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.567026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be created. [ 946.593211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.593387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.593551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.593748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.593946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.605591] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: UNINITIALIZED for 2s [ 946.821905] env[65899]: INFO networking_nsxv3.common.synchronization [req-e14a7342-9a2e-4b94-9027-7eaee1b0a861 req-74bd08e2-bddd-45b7-9f5c-979c16d8572f tempest-ListImageFiltersTestJSON-940002557 tempest-ListImageFiltersTestJSON-940002557-project-member] Enqueued Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 946.822510] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085ff348-1812-4078-9ad5-3958496f698b with Priority: HIGHEST for action security_group_members [ 946.822818] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-085ff348-1812-4078-9ad5-3958496f698b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.822956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.823131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.823745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.823745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.824304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.824304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.824559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.824637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.825080] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085ff348-1812-4078-9ad5-3958496f698b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.202391] env[65899]: INFO networking_nsxv3.common.synchronization [req-3cbfe653-d793-4275-886d-8ae85d0b187d req-9777b22a-ae75-4ffc-b3e6-3825b6549def tempest-ServerRescueNegativeTestJSON-46823991 tempest-ServerRescueNegativeTestJSON-46823991-project-member] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 947.203054] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 947.203395] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.203497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.327410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.327565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.327565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.327763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.328084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.328084] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.328212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.328212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.328366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.328420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.328480] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085ff348-1812-4078-9ad5-3958496f698b is going to be updated. [ 947.360359] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.360569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.360640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.360859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.361008] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.371387] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: IN_PROGRESS for 2s [ 947.528443] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.528443] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.528443] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.528443] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.528855] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.529286] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.530029] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.530920] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.535597] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.535597] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.535597] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.535793] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.535831] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.536056] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.536651] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.536651] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.557869] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.558150] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.560121] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.560121] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.560121] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-9da554b9-1894-4c56-b544-34a95229859b taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.560121] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-9da554b9-1894-4c56-b544-34a95229859b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.560121] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-9da554b9-1894-4c56-b544-34a95229859b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.560121] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-9da554b9-1894-4c56-b544-34a95229859b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.560121] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9da554b9-1894-4c56-b544-34a95229859b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.068334] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.068537] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.069026] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.069026] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.069171] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.069236] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 9da554b9-1894-4c56-b544-34a95229859b not found, creating... [ 948.069485] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.069637] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.070766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.070766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.070766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.070766] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.070766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.070766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.071061] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.071061] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.071220] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 9da554b9-1894-4c56-b544-34a95229859b is going to be created. [ 948.100547] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.100768] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.101828] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.101828] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.101828] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.101828] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-9da554b9-1894-4c56-b544-34a95229859b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.622470] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: SUCCESS [ 948.622470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.622470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.623044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.623044] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.623044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.623174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.623223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.623394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.623394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.624168] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.624484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.624661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.624834] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.624938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.624999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.625731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.625868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.625932] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.805066] env[65899]: INFO networking_nsxv3.common.synchronization [req-710ec8a1-d639-46b5-b281-cedf8b547201 req-aa4862b6-497e-45e4-92db-a9246d03fdc8 tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 948.805579] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 948.806101] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.806232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.806298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.806500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.806822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.806822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.806822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.807051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.807051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.807816] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.841841] env[65899]: INFO networking_nsxv3.common.synchronization [req-3cbfe653-d793-4275-886d-8ae85d0b187d req-ef8d56a4-cba7-43f2-a248-8bae359e4666 service nova] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_rules [ 948.842029] env[65899]: INFO networking_nsxv3.common.synchronization [req-3cbfe653-d793-4275-886d-8ae85d0b187d req-ef8d56a4-cba7-43f2-a248-8bae359e4666 service nova] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 948.842210] env[65899]: INFO networking_nsxv3.common.synchronization [req-3cbfe653-d793-4275-886d-8ae85d0b187d req-ef8d56a4-cba7-43f2-a248-8bae359e4666 service nova] Enqueued Resource ID: 9da554b9-1894-4c56-b544-34a95229859b with Priority: HIGHEST for action port [ 948.842716] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_rules [ 948.842853] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 948.842949] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9da554b9-1894-4c56-b544-34a95229859b with Priority: HIGHEST for action port [ 948.843519] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.843639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.843922] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.844022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.844201] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-9da554b9-1894-4c56-b544-34a95229859b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.844373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9da554b9-1894-4c56-b544-34a95229859b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.844373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9da554b9-1894-4c56-b544-34a95229859b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.844715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9da554b9-1894-4c56-b544-34a95229859b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.844715] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9da554b9-1894-4c56-b544-34a95229859b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.128362] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.128653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.128801] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.310128] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.310294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.310360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.311091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.311091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.311091] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.311091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.311091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.311367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.311367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.311367] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 949.347458] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9da554b9-1894-4c56-b544-34a95229859b with status ACTIVE [ 949.347458] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.347458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.347458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.347636] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.347781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.348010] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.348162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.348233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.348403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.348484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.348682] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.348845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.348883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.349018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.349101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.349186] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9da554b9-1894-4c56-b544-34a95229859b is going to be updated. [ 949.362256] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.362427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.362498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.362970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.363139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.375591] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 949.377611] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.377754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.377824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.378113] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.378263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.378462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9da554b9-1894-4c56-b544-34a95229859b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.384190] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085ff348-1812-4078-9ad5-3958496f698b in Status: SUCCESS [ 949.384420] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085ff348-1812-4078-9ad5-3958496f698b deletion is rescheduled due to dependency. [ 949.384535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085ff348-1812-4078-9ad5-3958496f698b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.630579] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.949396] env[65899]: INFO networking_nsxv3.common.synchronization [req-b6fea4c5-b11a-43d3-a018-a4002b5e4399 req-91c7abfe-ce77-4a78-b668-c48f2e286f79 tempest-ServersAdminTestJSON-2084545516 tempest-ServersAdminTestJSON-2084545516-project-member] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 949.949768] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 949.950068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.950195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.950261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.950504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.950655] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.950750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.950811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.950953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.951195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.951303] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.133342] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.133625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.133725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.134111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.134111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.134417] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be updated. [ 950.169344] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.169527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.169527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.169732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.169874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.180567] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: IN_PROGRESS for 2s [ 950.395406] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.396790] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.396790] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.396790] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.396790] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.396790] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.396790] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.397089] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.397141] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.397327] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.397506] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.397620] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.397720] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.397823] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.397920] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.398064] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.419947] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.420190] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.420326] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.420496] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.420849] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-33c935f7-4ceb-4e25-9276-e4a2682de229 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.422015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-33c935f7-4ceb-4e25-9276-e4a2682de229" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.422015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-33c935f7-4ceb-4e25-9276-e4a2682de229" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.422015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-33c935f7-4ceb-4e25-9276-e4a2682de229" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.422015] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c935f7-4ceb-4e25-9276-e4a2682de229',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.454083] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.454083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.454083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.455176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.455295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.457024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.457024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.457024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.457024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.457024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.457024] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 already deleted. [ 950.457024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.924126] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.924544] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.924620] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.924988] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.925575] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.925575] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 33c935f7-4ceb-4e25-9276-e4a2682de229 not found, creating... [ 950.925867] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.926035] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.926159] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.926472] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.926700] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.927287] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.927535] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.927717] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.928042] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.928384] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.929523] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 33c935f7-4ceb-4e25-9276-e4a2682de229 is going to be created. [ 950.954991] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.955200] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.955317] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.956077] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.956077] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.956077] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-33c935f7-4ceb-4e25-9276-e4a2682de229" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.386131] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 951.386201] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 951.386324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.669019] env[65899]: INFO networking_nsxv3.common.synchronization [req-b6fea4c5-b11a-43d3-a018-a4002b5e4399 req-aacca25c-88d0-4967-bc0e-8db65266e7b1 service nova] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_rules [ 951.669019] env[65899]: INFO networking_nsxv3.common.synchronization [req-b6fea4c5-b11a-43d3-a018-a4002b5e4399 req-aacca25c-88d0-4967-bc0e-8db65266e7b1 service nova] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 951.669019] env[65899]: INFO networking_nsxv3.common.synchronization [req-b6fea4c5-b11a-43d3-a018-a4002b5e4399 req-aacca25c-88d0-4967-bc0e-8db65266e7b1 service nova] Enqueued Resource ID: 33c935f7-4ceb-4e25-9276-e4a2682de229 with Priority: HIGHEST for action port [ 951.669019] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_rules [ 951.669019] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 951.669019] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c935f7-4ceb-4e25-9276-e4a2682de229 with Priority: HIGHEST for action port [ 951.669019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.669019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.669019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.669627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.669627] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.670341] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.670521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.670597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.670975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.671031] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.671135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.671238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.671389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.672990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.672990] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.672990] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c935f7-4ceb-4e25-9276-e4a2682de229 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.673294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c935f7-4ceb-4e25-9276-e4a2682de229" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.673294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c935f7-4ceb-4e25-9276-e4a2682de229" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.673375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c935f7-4ceb-4e25-9276-e4a2682de229" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.673406] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c935f7-4ceb-4e25-9276-e4a2682de229',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.176029] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.176372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.176372] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.177172] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33c935f7-4ceb-4e25-9276-e4a2682de229 with status ACTIVE [ 952.177356] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.177470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.177541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.177728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.177862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.178043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.178118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.178118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.178268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.178389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.178526] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.178599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.179332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.181297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.181297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.181297] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33c935f7-4ceb-4e25-9276-e4a2682de229 is going to be updated. [ 952.193896] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: SUCCESS [ 952.194134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.194630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.194839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.195035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.195157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.195223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.195395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.195492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.195585] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.203807] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.203932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.203996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.204208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.204361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.204516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c935f7-4ceb-4e25-9276-e4a2682de229" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.580701] env[65899]: INFO networking_nsxv3.common.synchronization [req-ca454b16-0fd7-41b7-84d5-99808b6c5624 req-155cb5ed-4183-4e36-95ae-466d9093db5b tempest-ServersAdminTestJSON-2084545516 tempest-ServersAdminTestJSON-2084545516-project-member] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 952.581238] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 952.581532] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.581667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.683589] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.699171] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.186481] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.186768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.186768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.187064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.187200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.187327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be created. [ 953.203040] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.211805] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.211971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.212050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.212723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.212723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.223450] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: UNINITIALIZED for 2s [ 953.415124] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.415353] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.415478] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.415781] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.416141] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.416318] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.416456] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.416704] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.416871] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.417118] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.417258] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.417390] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.417511] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.417633] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.417772] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.417912] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.437774] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.438184] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 953.438184] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.438308] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.438614] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-eecb7682-92ec-4bcb-b9ad-d8769507d89b taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.438789] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-eecb7682-92ec-4bcb-b9ad-d8769507d89b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.438907] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-eecb7682-92ec-4bcb-b9ad-d8769507d89b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.439344] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-eecb7682-92ec-4bcb-b9ad-d8769507d89b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.439481] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eecb7682-92ec-4bcb-b9ad-d8769507d89b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.706240] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.706452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.706524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.706711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.706805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.706895] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be updated. [ 953.739211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.739390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.739458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.739766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.739839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.749797] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: IN_PROGRESS for 2s [ 953.941885] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.942217] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.942440] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.942860] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.943097] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.943347] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port eecb7682-92ec-4bcb-b9ad-d8769507d89b not found, creating... [ 953.943874] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.944184] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.944379] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.944725] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.944935] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.945402] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.945632] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.945810] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.946156] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.946359] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.946580] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: eecb7682-92ec-4bcb-b9ad-d8769507d89b is going to be created. [ 953.969501] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.969706] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.969822] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.970144] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.970372] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.970594] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-eecb7682-92ec-4bcb-b9ad-d8769507d89b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.007334] env[65899]: INFO networking_nsxv3.common.synchronization [None req-ed19dc92-a4f7-4e3f-a683-4a600c9e38cd tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_rules [ 954.007858] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_rules [ 954.008182] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.008305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.008371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.008627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.008713] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.528809] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.529236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.529236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.529236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.529353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.529399] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 already deleted. [ 954.529480] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.695981] env[65899]: INFO networking_nsxv3.common.synchronization [req-ca454b16-0fd7-41b7-84d5-99808b6c5624 req-0cb43252-b6d7-4eb4-9cb8-cb874abace65 service nova] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_rules [ 954.696493] env[65899]: INFO networking_nsxv3.common.synchronization [req-ca454b16-0fd7-41b7-84d5-99808b6c5624 req-0cb43252-b6d7-4eb4-9cb8-cb874abace65 service nova] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 954.699559] env[65899]: INFO networking_nsxv3.common.synchronization [req-ca454b16-0fd7-41b7-84d5-99808b6c5624 req-0cb43252-b6d7-4eb4-9cb8-cb874abace65 service nova] Enqueued Resource ID: eecb7682-92ec-4bcb-b9ad-d8769507d89b with Priority: HIGHEST for action port [ 954.699559] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_rules [ 954.699559] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 954.699559] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eecb7682-92ec-4bcb-b9ad-d8769507d89b with Priority: HIGHEST for action port [ 954.699559] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.699559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.699559] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.699559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.699559] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-eecb7682-92ec-4bcb-b9ad-d8769507d89b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.699559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eecb7682-92ec-4bcb-b9ad-d8769507d89b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.699559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eecb7682-92ec-4bcb-b9ad-d8769507d89b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.700060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eecb7682-92ec-4bcb-b9ad-d8769507d89b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.700060] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eecb7682-92ec-4bcb-b9ad-d8769507d89b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.881041] env[65899]: INFO networking_nsxv3.common.synchronization [None req-b17bd004-c142-4419-b541-29da46555d8f tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_rules [ 954.882059] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_rules [ 954.882371] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.882502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.882568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.882808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.882893] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.202476] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eecb7682-92ec-4bcb-b9ad-d8769507d89b with status ACTIVE [ 955.202689] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.202788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.202837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.203043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.203157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.203338] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.203434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.203494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.203656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.203736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.204035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.204035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.204291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.204291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.204416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.204416] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eecb7682-92ec-4bcb-b9ad-d8769507d89b is going to be updated. [ 955.235213] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eecb7682-92ec-4bcb-b9ad-d8769507d89b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.235213] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.235213] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.235213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.235946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.236168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.236382] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.237675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.237966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.238340] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.238592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.238771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.239392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.241150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.241150] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.405942] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.406118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.406183] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.406406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.406518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.406616] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 already deleted. [ 955.406724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.459482] env[65899]: INFO networking_nsxv3.common.synchronization [req-939cad91-af88-4bf3-98c8-84704fd11d33 req-c764dcdf-a189-4f79-887f-16da7d89c8eb tempest-ServerAddressesNegativeTestJSON-580563959 tempest-ServerAddressesNegativeTestJSON-580563959-project-member] Enqueued Resource ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba with Priority: HIGHEST for action security_group_members [ 955.460015] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba with Priority: HIGHEST for action security_group_members [ 955.460341] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.461239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.461239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.461239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.461239] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.462814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.462970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.463101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.463194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.463258] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4062aa-2f69-4b3d-8c17-d03ee84455ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.743491] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.743922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.743922] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.785167] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: IN_PROGRESS for 4s [ 955.966321] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.966450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.966485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.966739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.966830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.967040] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.967259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.967356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.967551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.967657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.967770] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba already deleted. [ 955.967876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.969794] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.970037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-332" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.970198] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-332" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.970580] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-332" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.970893] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.971216] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.971734] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.971734] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.971734] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.971999] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.972215] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.972387] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.972532] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.972678] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.972811] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.972975] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.991775] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.991945] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 955.992086] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.992276] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-332" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.992614] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.992828] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.992890] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.993268] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.993432] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.246981] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.496725] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.496955] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.497096] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.497436] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.497597] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.497725] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67 not found, creating... [ 956.497977] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.498173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.498289] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.498570] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.498643] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.498924] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.499747] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.499900] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.500211] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.500303] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.500450] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67 is going to be created. [ 956.519613] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.519832] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.519955] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.520251] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.520473] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.520684] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.750707] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.751043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.751043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.751189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.751749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.751749] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 956.784620] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.784620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.784886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.785840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.785840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.795892] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 957.259546] env[65899]: INFO networking_nsxv3.common.synchronization [req-939cad91-af88-4bf3-98c8-84704fd11d33 req-4f63a0ac-8e5d-41a6-9f42-dab4e0f4c360 service nova] Enqueued Resource ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba with Priority: HIGHEST for action security_group_rules [ 957.259975] env[65899]: INFO networking_nsxv3.common.synchronization [req-939cad91-af88-4bf3-98c8-84704fd11d33 req-4f63a0ac-8e5d-41a6-9f42-dab4e0f4c360 service nova] Enqueued Resource ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba with Priority: HIGHEST for action security_group_members [ 957.260762] env[65899]: INFO networking_nsxv3.common.synchronization [req-939cad91-af88-4bf3-98c8-84704fd11d33 req-4f63a0ac-8e5d-41a6-9f42-dab4e0f4c360 service nova] Enqueued Resource ID: e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67 with Priority: HIGHEST for action port [ 957.264055] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba with Priority: HIGHEST for action security_group_rules [ 957.264055] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba with Priority: HIGHEST for action security_group_members [ 957.264055] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67 with Priority: HIGHEST for action port [ 957.264055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e4062aa-2f69-4b3d-8c17-d03ee84455ba taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.264055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.264055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.264055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.264055] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e4062aa-2f69-4b3d-8c17-d03ee84455ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.264055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.264055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.264055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.264055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.264055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.264055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.264055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.265415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.265973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.266203] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4062aa-2f69-4b3d-8c17-d03ee84455ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.268776] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.268776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.268776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.268776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.268776] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.756567] env[65899]: INFO networking_nsxv3.common.synchronization [None req-efc0c847-786d-445f-8e9e-66cbbebd3d17 None None] Enqueued Resource ID: fa1143e4-5929-4f8a-8be4-1e1911854cd6 with Priority: HIGHEST for action port [ 957.757072] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1143e4-5929-4f8a-8be4-1e1911854cd6 with Priority: HIGHEST for action port [ 957.757396] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa1143e4-5929-4f8a-8be4-1e1911854cd6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.757521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa1143e4-5929-4f8a-8be4-1e1911854cd6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.757590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa1143e4-5929-4f8a-8be4-1e1911854cd6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.757836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa1143e4-5929-4f8a-8be4-1e1911854cd6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.757911] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa1143e4-5929-4f8a-8be4-1e1911854cd6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.769975] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e4062aa-2f69-4b3d-8c17-d03ee84455ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.770886] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.771021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.774029] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67 with status ACTIVE [ 957.774029] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.774029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.774228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.774302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.774640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.774640] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.774764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.774764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.774928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.774988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.775221] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.775348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.775421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.775567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.775641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.775724] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67 is going to be updated. [ 957.796335] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: SUCCESS [ 957.796672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.796858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.797093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.797288] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.797730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.797730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.797730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.797730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.797934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.797934] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.798103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.798103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.798200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.798336] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.798441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.798498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.798591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.798774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.798774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.798992] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.800897] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.801128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.801128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.801252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.801338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.801482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5c4f4c4-b976-4e2c-9fbc-96bf3ee44f67" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.262202] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa1143e4-5929-4f8a-8be4-1e1911854cd6 [ 958.262202] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.262202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.262202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.262202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.262202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.262202] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa1143e4-5929-4f8a-8be4-1e1911854cd6 already deleted. [ 958.262202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa1143e4-5929-4f8a-8be4-1e1911854cd6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.274761] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e4062aa-2f69-4b3d-8c17-d03ee84455ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.303420] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3042d77c-efdf-4ff4-8800-d0a920f9e548: rpc.has_security_group_logging(os_id): False [ 958.324426] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.324553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.324553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.324791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.324882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.325106] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.325218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.325269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.327251] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.327251] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.327251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.327251] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be created. [ 958.405436] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.405436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.405680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.405680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.406103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.423543] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: IN_PROGRESS for 2s [ 958.780424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.780808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.780808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.781810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.781915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.782097] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba is going to be created. [ 958.818021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 958.818021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.818021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.818021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.818021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.818021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.818021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.818021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.818021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.818021] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.821275] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.821275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.821514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.821514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.821650] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.836841] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba in Status: UNINITIALIZED for 2s [ 959.324689] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.827587] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.924955] env[65899]: INFO networking_nsxv3.common.synchronization [req-9945454d-96e4-4e4a-848c-f181e7f3363a req-b8a99c63-4f39-4b8a-afe4-7308892a176e tempest-MigrationsAdminTest-1684116011 tempest-MigrationsAdminTest-1684116011-project-member] Enqueued Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 959.926234] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 959.928171] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.928171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.928171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.928171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.928171] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.928171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.928171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.928171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.928645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.928645] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.330287] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.330483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.330483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.330795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.330795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.330795] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 960.365743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.365907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.365950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.366176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.366316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.376580] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 960.431998] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.437365] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: SUCCESS [ 960.437635] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.438472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.438472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.438472] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.821265] env[65899]: INFO networking_nsxv3.common.synchronization [None req-217980d7-08d5-4a65-84cb-e4df78bb0c7e None None] Enqueued Resource ID: 3d366071-3719-4b54-9c08-578fdf963fe0 with Priority: HIGHEST for action port [ 960.821707] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d366071-3719-4b54-9c08-578fdf963fe0 with Priority: HIGHEST for action port [ 960.821810] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d366071-3719-4b54-9c08-578fdf963fe0 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.822339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d366071-3719-4b54-9c08-578fdf963fe0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.822409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d366071-3719-4b54-9c08-578fdf963fe0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.822710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d366071-3719-4b54-9c08-578fdf963fe0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.822831] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d366071-3719-4b54-9c08-578fdf963fe0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.858033] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba in Status: SUCCESS [ 960.858363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.858837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.859177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.859305] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.859421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.859487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.859641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.859974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.859974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.859974] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e4062aa-2f69-4b3d-8c17-d03ee84455ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.936338] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.941741] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.941741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.941741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.941741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.941741] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.941741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.941741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.941741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.941741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.941741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.942256] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.328388] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d366071-3719-4b54-9c08-578fdf963fe0 [ 961.328646] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.328779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.328848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.329069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.329157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.329876] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d366071-3719-4b54-9c08-578fdf963fe0 already deleted. [ 961.329876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d366071-3719-4b54-9c08-578fdf963fe0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.362030] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.362187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.362327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.362812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.363034] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.363154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.363219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.363386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.363472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.363557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.363700] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.363787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.363838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.363974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.364121] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.364209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.364267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.364427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.364505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.364583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.364671] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e4062aa-2f69-4b3d-8c17-d03ee84455ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.438627] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.438627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.438627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.440299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.440486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.440654] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 is going to be updated. [ 961.444601] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.444763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.444808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.445085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.445390] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.445488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.445488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.445679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.445757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.445839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.445982] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.446111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.446172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.446319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.446802] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.446931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.447034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.447325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.447325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.447484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.447536] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.485474] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.486185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.487100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.487100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.487100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.498879] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: IN_PROGRESS for 2s [ 961.868089] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e4062aa-2f69-4b3d-8c17-d03ee84455ba: rpc.has_security_group_logging(os_id): False [ 961.896552] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.896782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.896882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.897192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.897304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.897633] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.897805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.897873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.899078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.900831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.900831] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.900831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.900831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.900831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.900831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.900831] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.901551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.901551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.901551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.901551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.901551] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba is going to be created. [ 961.950908] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3042d77c-efdf-4ff4-8800-d0a920f9e548: rpc.has_security_group_logging(os_id): False [ 961.973348] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.973542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.973542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.976887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.976887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.976887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.976887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.977526] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.977526] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.977526] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.977526] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be updated. [ 961.996882] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.996882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.997111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.997378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.997495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.022717] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba in Status: IN_PROGRESS for 2s [ 962.119742] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.119742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.119742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.119742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.120883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.156499] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: IN_PROGRESS for 2s [ 962.388536] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 962.388744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.388917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.389146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.390823] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.391030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.391115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.391332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.391377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.391458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.391628] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.391730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.391792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.391937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.394173] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.394173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.394173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.394173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.394173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.394173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.394173] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.896123] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8062fa1b-833d-41ea-83be-2da29f1463e8: rpc.has_security_group_logging(os_id): False [ 962.917978] env[65899]: INFO networking_nsxv3.common.synchronization [req-dfe71844-1772-4cfb-b631-e9d71d2a11f1 req-4995e22a-6f55-4b6c-8d9f-d69299d3f579 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 962.919187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.919535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.919535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.920142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.920142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.920142] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.920305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.920305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.920462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.920462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.920641] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.920856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.920856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.921271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.921271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.921271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.921477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.921477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.921561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.921594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.921719] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be created. [ 962.923380] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 962.923856] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.923970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.924059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.924239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.924416] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.924511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.924576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.924751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.924808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.924879] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.990658] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.990846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.990922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.991145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.991325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.009114] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 963.307481] env[65899]: INFO networking_nsxv3.common.synchronization [req-9e8cf07a-d340-4a55-bf7c-6a6f1470cc2f req-475228dd-a7ec-453b-b41b-52bb7041a909 tempest-ListServerFiltersTestJSON-273501370 tempest-ListServerFiltersTestJSON-273501370-project-member] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 963.307996] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGHEST for action security_group_members [ 963.308308] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.308430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.308496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.308727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.308917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.309030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.309094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.309311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.309401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.309494] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.428666] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.428802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.428866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.429156] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.429308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.429644] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.429767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.429833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.430058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.430163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.430254] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 963.463024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.463268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.463361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.463622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.463810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.472640] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 963.510785] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: SUCCESS [ 963.511184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.812515] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.812709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.812780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.812993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.813094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.813285] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.813431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.813508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.813792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.813922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.814031] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be updated. [ 963.852455] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.852875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.852875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.853128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.853344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.868941] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: IN_PROGRESS for 2s [ 964.036811] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba in Status: SUCCESS [ 964.037123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.170916] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: SUCCESS [ 964.171176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.021811] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 965.021811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.021811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.021811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.021811] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.483493] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 965.483802] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b deletion is rescheduled due to dependency. [ 965.485524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.528544] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.528749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.528808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.529013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.529193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.529291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.529353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.529501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.529588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.529782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.529782] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.882083] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 in Status: SUCCESS [ 965.882715] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 deletion is rescheduled due to dependency. [ 965.882715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.036967] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.037141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.037245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.037434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.037602] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.037721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.037780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.037937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.038039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.038129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.038276] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.038369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.038425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.038565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.038697] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.038787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.038842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.039032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.039115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.039158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.039207] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.541143] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8062fa1b-833d-41ea-83be-2da29f1463e8: rpc.has_security_group_logging(os_id): False [ 966.560348] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.560489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.560555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.560767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.560849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.561075] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.561170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.561229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.561375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.561453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.562105] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.562214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.562325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.562431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.562502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.562685] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.562772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.562829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.563024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.563103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.563187] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 966.623969] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.624149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.624198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.624389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.624565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.636758] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 968.308622] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 968.309017] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 968.651658] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 968.652640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.482630] env[65899]: INFO networking_nsxv3.common.synchronization [req-4821e830-d810-47c6-9aba-0de59c6dae7b req-9f4e97e8-98bf-4d94-b492-145e4753b799 tempest-MultipleCreateTestJSON-18633285 tempest-MultipleCreateTestJSON-18633285-project-member] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 969.483309] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 969.483538] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.483951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.483951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.483951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.484138] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.484201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.484226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.484359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.484542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.484542] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.574864] env[65899]: INFO networking_nsxv3.common.synchronization [req-ec3a8982-df51-4bec-bf6e-97123644e6c6 req-7abc389f-d63a-4c52-9f85-298d81295325 tempest-ServerAddressesNegativeTestJSON-580563959 tempest-ServerAddressesNegativeTestJSON-580563959-project-member] Enqueued Resource ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba with Priority: HIGHEST for action security_group_members [ 969.575431] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba with Priority: HIGHEST for action security_group_members [ 969.576043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.576192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.576256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.576526] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.576597] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.576691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.576751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.576888] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.576967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.577087] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4062aa-2f69-4b3d-8c17-d03ee84455ba',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.828250] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.828476] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.828591] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.828876] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.829230] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.829420] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.829544] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.829786] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.829952] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.830443] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.830499] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.830606] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.830734] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.830843] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.830978] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.831106] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.853070] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.853254] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.853254] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.853446] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.853782] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-bf48500d-59ee-456b-8312-8ef2389ce4a6 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.853957] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-bf48500d-59ee-456b-8312-8ef2389ce4a6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.854086] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-bf48500d-59ee-456b-8312-8ef2389ce4a6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.854516] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-bf48500d-59ee-456b-8312-8ef2389ce4a6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.854717] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf48500d-59ee-456b-8312-8ef2389ce4a6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.988897] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.989065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.989139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.989342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.989427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.989615] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.989707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.989776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.989895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.989965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.990103] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be deleted. [ 970.018387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.018554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.018661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.018852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.019072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.019072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.079496] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.079631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.079699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.079941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.080045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.080235] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.080331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.080390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.080549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.080622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.080710] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba is going to be updated. [ 970.112139] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.112317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.112371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.112589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.112733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.124155] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba in Status: IN_PROGRESS for 2s [ 970.357192] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.357413] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.357549] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.357841] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.357983] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.358145] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port bf48500d-59ee-456b-8312-8ef2389ce4a6 not found, creating... [ 970.358402] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.358555] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.358673] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.359095] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.359179] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.359898] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.359898] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.359898] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.359898] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.360256] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.360256] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: bf48500d-59ee-456b-8312-8ef2389ce4a6 is going to be created. [ 970.382984] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.383298] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.383495] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.383766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.384047] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.384314] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-bf48500d-59ee-456b-8312-8ef2389ce4a6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.175256] env[65899]: INFO networking_nsxv3.common.synchronization [req-4821e830-d810-47c6-9aba-0de59c6dae7b req-ed3039d0-0cac-467a-b0c4-2739f4c9dbe9 service nova] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_rules [ 971.175256] env[65899]: INFO networking_nsxv3.common.synchronization [req-4821e830-d810-47c6-9aba-0de59c6dae7b req-ed3039d0-0cac-467a-b0c4-2739f4c9dbe9 service nova] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 971.175256] env[65899]: INFO networking_nsxv3.common.synchronization [req-4821e830-d810-47c6-9aba-0de59c6dae7b req-ed3039d0-0cac-467a-b0c4-2739f4c9dbe9 service nova] Enqueued Resource ID: bf48500d-59ee-456b-8312-8ef2389ce4a6 with Priority: HIGHEST for action port [ 971.175564] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_rules [ 971.175657] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 971.175745] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf48500d-59ee-456b-8312-8ef2389ce4a6 with Priority: HIGHEST for action port [ 971.176328] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.177151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.177151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.177151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.177151] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.177926] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.178064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.178129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.178285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.178777] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.178777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.178883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.178986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.179078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.179170] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.179931] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf48500d-59ee-456b-8312-8ef2389ce4a6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.181476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf48500d-59ee-456b-8312-8ef2389ce4a6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.181476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf48500d-59ee-456b-8312-8ef2389ce4a6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.181476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf48500d-59ee-456b-8312-8ef2389ce4a6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.181476] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf48500d-59ee-456b-8312-8ef2389ce4a6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.684144] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.685294] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.685408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.685641] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf48500d-59ee-456b-8312-8ef2389ce4a6 with status ACTIVE [ 971.685815] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.685815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.685884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.686159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.686159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.686325] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.686414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.686476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.686779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.686779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.686853] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.686957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.686998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.687269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.687296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.687358] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf48500d-59ee-456b-8312-8ef2389ce4a6 is going to be updated. [ 971.708697] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.708875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.709130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.709183] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.709293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.709447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf48500d-59ee-456b-8312-8ef2389ce4a6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.136991] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba in Status: SUCCESS [ 972.137196] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4062aa-2f69-4b3d-8c17-d03ee84455ba deletion is rescheduled due to dependency. [ 972.137306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4062aa-2f69-4b3d-8c17-d03ee84455ba" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.189228] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.692856] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.693014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.693092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.693300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.693470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.693470] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be created. [ 972.717270] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.717270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.717427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.717555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.717689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.728566] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: UNINITIALIZED for 2s [ 974.148137] env[65899]: INFO networking_nsxv3.common.synchronization [req-4821e830-d810-47c6-9aba-0de59c6dae7b req-4a108774-b7ad-4ee1-863f-ca524c83b0a2 tempest-MultipleCreateTestJSON-18633285 tempest-MultipleCreateTestJSON-18633285-project-member] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 974.148137] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 974.148137] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.148137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.455069] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.455274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.455402] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.455662] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.455911] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.456071] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.456186] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.456390] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.457603] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.457603] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.457603] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.457603] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.457603] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.457603] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.457603] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.457603] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.479208] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.479379] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.479505] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.479675] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-155" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.479982] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-123142fb-f172-4d1a-8aa0-98a5e2b913c8 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.480215] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-123142fb-f172-4d1a-8aa0-98a5e2b913c8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.480311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-123142fb-f172-4d1a-8aa0-98a5e2b913c8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.480725] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-123142fb-f172-4d1a-8aa0-98a5e2b913c8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.480914] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('123142fb-f172-4d1a-8aa0-98a5e2b913c8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.740637] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 974.740856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.741042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.741258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.741461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.741572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.741625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.741895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.742161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.742275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.743020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.743300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.743462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.743775] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.743885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.743947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.744104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.744180] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.744264] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.983697] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.983928] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.984071] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.984383] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.984601] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.984771] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 123142fb-f172-4d1a-8aa0-98a5e2b913c8 not found, creating... [ 974.985064] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.985231] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.985349] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.985601] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.985748] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.986036] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.986195] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.986310] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.986528] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.986664] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.986797] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 123142fb-f172-4d1a-8aa0-98a5e2b913c8 is going to be created. [ 975.009456] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.009659] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.010081] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.010081] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.010269] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.010493] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-123142fb-f172-4d1a-8aa0-98a5e2b913c8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.246393] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.246755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.248080] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.711309] env[65899]: INFO networking_nsxv3.common.synchronization [req-4821e830-d810-47c6-9aba-0de59c6dae7b req-88075710-30e6-4265-9c94-35be2d30257f service nova] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_rules [ 975.711519] env[65899]: INFO networking_nsxv3.common.synchronization [req-4821e830-d810-47c6-9aba-0de59c6dae7b req-88075710-30e6-4265-9c94-35be2d30257f service nova] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 975.711662] env[65899]: INFO networking_nsxv3.common.synchronization [req-4821e830-d810-47c6-9aba-0de59c6dae7b req-88075710-30e6-4265-9c94-35be2d30257f service nova] Enqueued Resource ID: 123142fb-f172-4d1a-8aa0-98a5e2b913c8 with Priority: HIGHEST for action port [ 975.712273] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_rules [ 975.712432] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 975.712568] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123142fb-f172-4d1a-8aa0-98a5e2b913c8 with Priority: HIGHEST for action port [ 975.712826] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.712922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.713125] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.713201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.713372] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-123142fb-f172-4d1a-8aa0-98a5e2b913c8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.713465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-123142fb-f172-4d1a-8aa0-98a5e2b913c8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.713538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-123142fb-f172-4d1a-8aa0-98a5e2b913c8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.713746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-123142fb-f172-4d1a-8aa0-98a5e2b913c8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.713815] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('123142fb-f172-4d1a-8aa0-98a5e2b913c8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.750481] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.217760] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 123142fb-f172-4d1a-8aa0-98a5e2b913c8 with status ACTIVE [ 976.218182] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.218389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.218472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.218723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.218821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.219057] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.219192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.219256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.219428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.219517] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.219762] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.219865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.219919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.220082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.220156] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.220242] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 123142fb-f172-4d1a-8aa0-98a5e2b913c8 is going to be updated. [ 976.242571] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.242796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.242870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.243108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.243248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.243412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-123142fb-f172-4d1a-8aa0-98a5e2b913c8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.254108] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.254576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.254576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.254766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.254890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.255101] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 976.285342] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.285503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.285554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.285789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.286024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.309551] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 976.669792] env[65899]: INFO networking_nsxv3.common.synchronization [req-e1a8c7c3-2826-48e6-98f2-83488af37738 req-a370796b-d7a2-456a-bb60-92fda0c4f061 tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 976.670615] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 976.671077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.671250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.671344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.671622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.671862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.672012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.672098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.672349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.672466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.672621] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.047347] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.047571] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.047720] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.049738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.049738] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.049738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.049738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.049738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.049738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.049738] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.049738] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.049738] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.049738] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.049738] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.049738] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.050203] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.074636] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.074835] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.075690] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.075690] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.075690] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-7f991c78-4e9b-41e3-a7c5-c16d630ba831 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.075690] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-7f991c78-4e9b-41e3-a7c5-c16d630ba831" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.075890] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-7f991c78-4e9b-41e3-a7c5-c16d630ba831" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.076237] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-7f991c78-4e9b-41e3-a7c5-c16d630ba831" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.076375] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f991c78-4e9b-41e3-a7c5-c16d630ba831',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.176941] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.578923] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.579217] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.579322] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.579598] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.579752] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.579897] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 7f991c78-4e9b-41e3-a7c5-c16d630ba831 not found, creating... [ 977.580172] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.580328] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.580444] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.580660] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.580795] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.581101] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.581259] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.581377] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.581599] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.581752] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.582068] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 7f991c78-4e9b-41e3-a7c5-c16d630ba831 is going to be created. [ 977.606979] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.607216] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.607342] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.607660] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.607966] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.608152] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-7f991c78-4e9b-41e3-a7c5-c16d630ba831" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.679566] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.182399] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.182566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.182640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.182933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.183077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.183225] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 978.231249] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.231413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.231486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.231736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.231903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.248949] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 978.328685] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 978.328910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.329113] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.329335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.329527] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.329646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.329704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.329863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.329945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.330037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.330208] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.330294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.330352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.330477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.330611] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.330704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.330759] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.330891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.330961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.332432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.332599] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.334581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.337812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.337812] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.337812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.337812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.337812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.337812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.337812] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.348053] env[65899]: INFO networking_nsxv3.common.synchronization [req-e1a8c7c3-2826-48e6-98f2-83488af37738 req-9f283a24-5f71-48f9-9d8e-b9311c135aa0 service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 978.348053] env[65899]: INFO networking_nsxv3.common.synchronization [req-e1a8c7c3-2826-48e6-98f2-83488af37738 req-9f283a24-5f71-48f9-9d8e-b9311c135aa0 service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 978.348053] env[65899]: INFO networking_nsxv3.common.synchronization [req-e1a8c7c3-2826-48e6-98f2-83488af37738 req-9f283a24-5f71-48f9-9d8e-b9311c135aa0 service nova] Enqueued Resource ID: 7f991c78-4e9b-41e3-a7c5-c16d630ba831 with Priority: HIGHEST for action port [ 978.348053] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 978.348053] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 978.348053] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f991c78-4e9b-41e3-a7c5-c16d630ba831 with Priority: HIGHEST for action port [ 978.348053] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.348053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.348053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.348608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.348608] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.349530] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.349530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.349530] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f991c78-4e9b-41e3-a7c5-c16d630ba831 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.349530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f991c78-4e9b-41e3-a7c5-c16d630ba831" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.349771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f991c78-4e9b-41e3-a7c5-c16d630ba831" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.349771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f991c78-4e9b-41e3-a7c5-c16d630ba831" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.349821] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f991c78-4e9b-41e3-a7c5-c16d630ba831',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.842119] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.842119] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3: rpc.has_security_group_logging(os_id): False [ 978.855164] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.855164] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f991c78-4e9b-41e3-a7c5-c16d630ba831 with status ACTIVE [ 978.855164] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.855164] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.855164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.855164] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.855678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.855678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.855678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.855678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.855678] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f991c78-4e9b-41e3-a7c5-c16d630ba831 is going to be updated. [ 978.872486] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.872680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.872733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.872919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.873011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.873207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.873305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.873362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.873503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.873578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.873768] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.873859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.873917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.874067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.874141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.874317] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.874404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.874460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.874662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.874737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.874818] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be created. [ 978.889057] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.889206] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.889241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.889430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.889561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.889709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f991c78-4e9b-41e3-a7c5-c16d630ba831" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.945762] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.946326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.946326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.946326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.946456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.972764] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 979.345760] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.790361] env[65899]: INFO networking_nsxv3.common.synchronization [req-bfccab85-3a87-4170-b2e4-06ae00665aac req-836232b4-ae2a-4de5-84b5-ce35cf2639e8 tempest-ImagesNegativeTestJSON-1003871092 tempest-ImagesNegativeTestJSON-1003871092-project-member] Enqueued Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGHEST for action security_group_members [ 979.790361] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGHEST for action security_group_members [ 979.790361] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad542a16-77ff-4002-b217-5630a01b6f17 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.790361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.790361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.790361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.790361] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.790657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.790657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.790745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.790774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.791762] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.848551] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.848858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.848858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.849683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.849807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.850059] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 979.902304] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.902457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.902530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.902746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.902892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.916280] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 980.186938] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.187218] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-744" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.187320] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-744" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.187704] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-744" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.188095] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.188284] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.188418] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.188699] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.188877] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.189126] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.189297] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.189434] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.189553] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.189716] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.189840] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.189995] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.213256] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.213436] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.213576] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.213754] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-744" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.214085] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-36c0a397-f863-4137-8e64-3cddbb7564d4 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.215991] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-36c0a397-f863-4137-8e64-3cddbb7564d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.215991] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-36c0a397-f863-4137-8e64-3cddbb7564d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.215991] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-36c0a397-f863-4137-8e64-3cddbb7564d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.215991] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36c0a397-f863-4137-8e64-3cddbb7564d4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.258900] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 980.259169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.259346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.259594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.259803] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.259933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.260014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.260182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.260275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.260372] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.294138] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.294333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.294431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.294708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.294813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.295056] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.295164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.295228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.295388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.295501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.295666] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad542a16-77ff-4002-b217-5630a01b6f17 already deleted. [ 980.295743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.717395] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.717638] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.717768] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.718068] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.718215] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.718365] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 36c0a397-f863-4137-8e64-3cddbb7564d4 not found, creating... [ 980.719666] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.719666] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.719666] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.719666] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.719666] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.719666] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.720119] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.720119] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.722166] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.722376] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.723549] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 36c0a397-f863-4137-8e64-3cddbb7564d4 is going to be created. [ 980.743884] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.744128] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.744473] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.744538] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.744971] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.745048] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-36c0a397-f863-4137-8e64-3cddbb7564d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.762907] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.988489] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 980.988751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.988751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.988936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.989038] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.265363] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.449222] env[65899]: INFO networking_nsxv3.common.synchronization [req-bfccab85-3a87-4170-b2e4-06ae00665aac req-71aa71c7-8248-4457-95de-e3a342ad5811 service nova] Enqueued Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGHEST for action security_group_rules [ 981.449307] env[65899]: INFO networking_nsxv3.common.synchronization [req-bfccab85-3a87-4170-b2e4-06ae00665aac req-71aa71c7-8248-4457-95de-e3a342ad5811 service nova] Enqueued Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGHEST for action security_group_members [ 981.449440] env[65899]: INFO networking_nsxv3.common.synchronization [req-bfccab85-3a87-4170-b2e4-06ae00665aac req-71aa71c7-8248-4457-95de-e3a342ad5811 service nova] Enqueued Resource ID: 36c0a397-f863-4137-8e64-3cddbb7564d4 with Priority: HIGHEST for action port [ 981.450226] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGHEST for action security_group_rules [ 981.450386] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGHEST for action security_group_members [ 981.450540] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36c0a397-f863-4137-8e64-3cddbb7564d4 with Priority: HIGHEST for action port [ 981.451643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad542a16-77ff-4002-b217-5630a01b6f17 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.451970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.451970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.452476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.452523] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.454190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad542a16-77ff-4002-b217-5630a01b6f17 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.454431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.454628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.455132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.456449] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.456504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.456533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.456713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.456812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.456945] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.459754] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-36c0a397-f863-4137-8e64-3cddbb7564d4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.459754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36c0a397-f863-4137-8e64-3cddbb7564d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.459754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36c0a397-f863-4137-8e64-3cddbb7564d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.459754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36c0a397-f863-4137-8e64-3cddbb7564d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.460157] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36c0a397-f863-4137-8e64-3cddbb7564d4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.491048] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.491048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.767759] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.767982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.768078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.768334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.768448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.768662] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 981.852027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.852027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.852266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.852470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.852725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.864331] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 981.925668] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 981.925881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.926075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.926287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.926479] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.926597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.926687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.926805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.926884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.926966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.927106] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.960618] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.962405] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad542a16-77ff-4002-b217-5630a01b6f17 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.962576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.963189] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36c0a397-f863-4137-8e64-3cddbb7564d4 with status ACTIVE [ 981.963448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.963513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.964240] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.964240] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.964816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.964816] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.964816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.964816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.964816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.965012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.965097] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.965203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.965264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.965457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.965540] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.965630] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36c0a397-f863-4137-8e64-3cddbb7564d4 is going to be updated. [ 981.992230] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.992611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.992611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.992713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.992871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.993115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36c0a397-f863-4137-8e64-3cddbb7564d4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.430898] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.430898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.430898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.431172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.431360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.431360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.431485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.431548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.431644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.431743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.431896] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.431988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.432062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.432216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.432338] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.432423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.432493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.432630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.432720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.432800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.433244] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.463301] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.935021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3: rpc.has_security_group_logging(os_id): False [ 982.954184] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.954378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.954420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.954688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.954774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.954991] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.955106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.955168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.955607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.955607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.955699] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.955842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.955842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.955966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.956115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.956254] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.956349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.956459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.956616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.956767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.956840] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 982.965973] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.966120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.966192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.966401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.966487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.966581] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad542a16-77ff-4002-b217-5630a01b6f17 is going to be created. [ 982.997601] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.997905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.997905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.998049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.998188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.019825] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad542a16-77ff-4002-b217-5630a01b6f17 in Status: UNINITIALIZED for 2s [ 983.033202] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.033335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.033403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.034258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.034258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.047144] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 983.883101] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 983.883319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.883495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.883710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.883908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.884035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.884099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.884252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.884332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.884413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.884500] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.204558] env[65899]: INFO networking_nsxv3.common.synchronization [req-d02bd08d-938b-405a-bd67-3cb6fc3b6de5 req-3d796109-a1a2-46fc-9f0e-f573441c056f tempest-ServersTestJSON-298606675 tempest-ServersTestJSON-298606675-project-member] Enqueued Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_members [ 984.205183] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGHEST for action security_group_members [ 984.205493] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.206511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.206511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.206511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.206743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.206989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.207066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.207262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.207411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.207564] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.393655] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.393655] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.393655] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.393655] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.393655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.394488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.394488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.394488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.394488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.394488] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.711074] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.711573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.711573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.711843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.713086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.713086] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.713086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.713086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.713086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.713086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.713086] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d is going to be updated. [ 984.749315] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.749398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.749430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.749815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.749969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.759053] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: IN_PROGRESS for 2s [ 984.897408] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc14a464-84a2-4f30-88ae-7b0da98e4e95: rpc.has_security_group_logging(os_id): False [ 984.918203] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.918203] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.918203] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.918203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.918702] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.918702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.919136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.919341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.919428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.919517] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 984.986478] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.986713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.986713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.987442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.987442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.002235] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 985.029424] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad542a16-77ff-4002-b217-5630a01b6f17 in Status: SUCCESS [ 985.030346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.030618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.030905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.031162] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.031322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.031423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.031760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.031921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.032109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.032282] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.081137] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 985.081431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.495796] env[65899]: INFO networking_nsxv3.common.synchronization [None req-f8e604cc-8c27-45ed-b4a7-8b0d8231d215 None None] Enqueued Resource ID: 244da707-bf17-46a6-a64e-5b417fa48006 with Priority: HIGHEST for action port [ 985.496337] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 244da707-bf17-46a6-a64e-5b417fa48006 with Priority: HIGHEST for action port [ 985.496638] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-244da707-bf17-46a6-a64e-5b417fa48006 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.496774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-244da707-bf17-46a6-a64e-5b417fa48006" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.496833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-244da707-bf17-46a6-a64e-5b417fa48006" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.497495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-244da707-bf17-46a6-a64e-5b417fa48006" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.498795] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('244da707-bf17-46a6-a64e-5b417fa48006',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.534503] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad542a16-77ff-4002-b217-5630a01b6f17 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.534760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.534838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.535164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.535244] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.535363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.535478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.535587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.535685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.535844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.535998] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad542a16-77ff-4002-b217-5630a01b6f17 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.536107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.536171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.536327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.536480] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.536586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.536638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.537079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.537079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.537079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.537079] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.002573] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 244da707-bf17-46a6-a64e-5b417fa48006 [ 986.002941] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.003089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.003155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.003378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.003461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.003563] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:244da707-bf17-46a6-a64e-5b417fa48006 already deleted. [ 986.003645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-244da707-bf17-46a6-a64e-5b417fa48006" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.040720] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad542a16-77ff-4002-b217-5630a01b6f17: rpc.has_security_group_logging(os_id): False [ 986.065366] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.065366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.065366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.065797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.065797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.065890] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.065960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.066021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.066205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.066265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.066466] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.066578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.066731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.066966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.067123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.067254] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.067352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.067412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.067555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.067643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.067750] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad542a16-77ff-4002-b217-5630a01b6f17 is going to be created. [ 986.135295] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.135533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.135698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.136205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.136440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.155605] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad542a16-77ff-4002-b217-5630a01b6f17 in Status: IN_PROGRESS for 2s [ 986.772396] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: IN_PROGRESS for 4s [ 986.867694] env[65899]: INFO networking_nsxv3.common.synchronization [req-011d1bac-5b37-4e07-9d54-ae09a0303be4 req-8393ad11-e8a0-489e-973a-9050e21f7d76 tempest-ImagesOneServerTestJSON-1733106166 tempest-ImagesOneServerTestJSON-1733106166-project-member] Enqueued Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGHEST for action security_group_members [ 986.868765] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGHEST for action security_group_members [ 986.868765] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada686fd-cb59-44cf-975b-4402d84546e6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.868983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.868983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.869248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.869435] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.869543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.869604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.869792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.869889] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.869972] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.035660] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 987.036097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.327961] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.328125] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-767" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.328182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-767" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.328481] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-767" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.328785] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.328885] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.328992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.330205] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.330359] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.330583] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.330733] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.330800] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.330905] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.331036] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.331172] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.331310] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.356383] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.356383] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 987.356383] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.356383] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-767" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.356383] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-5689733d-6263-42ea-8343-3c7a7afad2dd taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.356383] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-5689733d-6263-42ea-8343-3c7a7afad2dd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.356383] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-5689733d-6263-42ea-8343-3c7a7afad2dd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.357357] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-5689733d-6263-42ea-8343-3c7a7afad2dd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.357717] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5689733d-6263-42ea-8343-3c7a7afad2dd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.377923] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.377923] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.377923] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada686fd-cb59-44cf-975b-4402d84546e6 already deleted. [ 987.377923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.572697] env[65899]: INFO networking_nsxv3.common.synchronization [None req-1d910e3d-3f84-4000-a9dc-90ed3b82d10b None None] Enqueued Resource ID: a5fd9451-9be0-4e54-9a23-bb4a16a1ac54 with Priority: HIGHEST for action port [ 987.572697] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5fd9451-9be0-4e54-9a23-bb4a16a1ac54 with Priority: HIGHEST for action port [ 987.573344] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5fd9451-9be0-4e54-9a23-bb4a16a1ac54 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.573636] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5fd9451-9be0-4e54-9a23-bb4a16a1ac54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.573798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5fd9451-9be0-4e54-9a23-bb4a16a1ac54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.574143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5fd9451-9be0-4e54-9a23-bb4a16a1ac54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.574320] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5fd9451-9be0-4e54-9a23-bb4a16a1ac54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.860697] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.861091] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.861136] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.861438] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.861602] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.861764] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 5689733d-6263-42ea-8343-3c7a7afad2dd not found, creating... [ 987.862082] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.862285] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.862408] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.862690] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.862870] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.863209] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.863385] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.863503] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.863749] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.863894] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.864070] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 5689733d-6263-42ea-8343-3c7a7afad2dd is going to be created. [ 987.890387] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.890541] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.891297] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.891297] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.891297] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.891525] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-5689733d-6263-42ea-8343-3c7a7afad2dd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.080447] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5fd9451-9be0-4e54-9a23-bb4a16a1ac54 [ 988.080716] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.080872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.080919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.081383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.081383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.081383] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5fd9451-9be0-4e54-9a23-bb4a16a1ac54 already deleted. [ 988.081465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5fd9451-9be0-4e54-9a23-bb4a16a1ac54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.176443] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad542a16-77ff-4002-b217-5630a01b6f17 in Status: SUCCESS [ 988.176443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.624614] env[65899]: INFO networking_nsxv3.common.synchronization [req-011d1bac-5b37-4e07-9d54-ae09a0303be4 req-69cdb0cb-e77c-4197-a407-f285e3206f4b service nova] Enqueued Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGHEST for action security_group_rules [ 988.624953] env[65899]: INFO networking_nsxv3.common.synchronization [req-011d1bac-5b37-4e07-9d54-ae09a0303be4 req-69cdb0cb-e77c-4197-a407-f285e3206f4b service nova] Enqueued Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGHEST for action security_group_members [ 988.625197] env[65899]: INFO networking_nsxv3.common.synchronization [req-011d1bac-5b37-4e07-9d54-ae09a0303be4 req-69cdb0cb-e77c-4197-a407-f285e3206f4b service nova] Enqueued Resource ID: 5689733d-6263-42ea-8343-3c7a7afad2dd with Priority: HIGHEST for action port [ 988.625846] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGHEST for action security_group_rules [ 988.625984] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGHEST for action security_group_members [ 988.626097] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5689733d-6263-42ea-8343-3c7a7afad2dd with Priority: HIGHEST for action port [ 988.626410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ada686fd-cb59-44cf-975b-4402d84546e6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.626560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.626665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.627044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.627214] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.628134] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada686fd-cb59-44cf-975b-4402d84546e6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.628255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.628321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.628941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.629214] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.629372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.629463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.629689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.629783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.629923] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.631630] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5689733d-6263-42ea-8343-3c7a7afad2dd taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.631800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5689733d-6263-42ea-8343-3c7a7afad2dd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.631800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5689733d-6263-42ea-8343-3c7a7afad2dd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.632878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5689733d-6263-42ea-8343-3c7a7afad2dd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.632878] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5689733d-6263-42ea-8343-3c7a7afad2dd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.797912] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bf7771-fa03-4285-8780-9b265ead5b3d in Status: SUCCESS [ 988.799022] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d deletion is rescheduled due to dependency. [ 988.799022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.132420] env[65899]: INFO networking_nsxv3.common.synchronization [None req-6db99e5b-fe7c-4c64-b6af-7871d2e8a466 None None] Enqueued Resource ID: 9515b16d-6dee-466d-87fa-43abcd636464 with Priority: HIGHEST for action port [ 989.132420] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9515b16d-6dee-466d-87fa-43abcd636464 with Priority: HIGHEST for action port [ 989.132420] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-9515b16d-6dee-466d-87fa-43abcd636464 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.132420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9515b16d-6dee-466d-87fa-43abcd636464" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.132420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9515b16d-6dee-466d-87fa-43abcd636464" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.132420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9515b16d-6dee-466d-87fa-43abcd636464" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.132420] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9515b16d-6dee-466d-87fa-43abcd636464',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.135302] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada686fd-cb59-44cf-975b-4402d84546e6 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.135302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.135302] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.135919] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5689733d-6263-42ea-8343-3c7a7afad2dd with status ACTIVE [ 989.136171] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.136333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.136400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.136646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.136753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.137223] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.137223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.137223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.137398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.137499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.137772] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.137897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.137977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.138228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.138264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.138372] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5689733d-6263-42ea-8343-3c7a7afad2dd is going to be updated. [ 989.173803] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.174018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.174115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.174402] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.174585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.174825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5689733d-6263-42ea-8343-3c7a7afad2dd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.636426] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9515b16d-6dee-466d-87fa-43abcd636464 [ 989.636658] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.636806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.636890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.637194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.637288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.637379] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9515b16d-6dee-466d-87fa-43abcd636464 already deleted. [ 989.637461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9515b16d-6dee-466d-87fa-43abcd636464" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.640863] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.143425] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.143971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.143971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.143971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.143971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.144115] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada686fd-cb59-44cf-975b-4402d84546e6 is going to be created. [ 990.167028] env[65899]: INFO networking_nsxv3.common.synchronization [req-f9436803-9b38-4e43-931e-b4b99dd8661f req-1b433f01-a093-485c-bc15-25bd79322fa6 tempest-MultipleCreateTestJSON-18633285 tempest-MultipleCreateTestJSON-18633285-project-member] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 990.167028] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 990.167028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.167028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.167352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.167352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.167451] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.167544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.167608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.167760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.167869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.167942] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.188440] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.188603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.188715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.189222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.189294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.202240] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada686fd-cb59-44cf-975b-4402d84546e6 in Status: UNINITIALIZED for 2s [ 990.672434] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.931027] env[65899]: INFO networking_nsxv3.common.synchronization [req-d088da55-4a43-4144-89f6-920c5360100b req-33e42168-59c3-4514-8a8f-90a6600a8601 tempest-MultipleCreateTestJSON-18633285 tempest-MultipleCreateTestJSON-18633285-project-member] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 990.931027] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGHEST for action security_group_members [ 990.931027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.931027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.176899] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.679244] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.679408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.679479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.679695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.679784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.679881] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 991.717398] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.717668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.718139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.718139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.718352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.733658] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 991.774612] env[65899]: INFO networking_nsxv3.common.synchronization [None req-1e99f111-41ca-457a-83ad-bc03d4cefe6c None None] Enqueued Resource ID: 763e51c7-31a6-4297-a43a-d679ef104eb6 with Priority: HIGHEST for action port [ 991.775270] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763e51c7-31a6-4297-a43a-d679ef104eb6 with Priority: HIGHEST for action port [ 991.775604] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-763e51c7-31a6-4297-a43a-d679ef104eb6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.775735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-763e51c7-31a6-4297-a43a-d679ef104eb6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.775789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-763e51c7-31a6-4297-a43a-d679ef104eb6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.776053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-763e51c7-31a6-4297-a43a-d679ef104eb6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.776139] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('763e51c7-31a6-4297-a43a-d679ef104eb6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.214874] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada686fd-cb59-44cf-975b-4402d84546e6 in Status: SUCCESS [ 992.215190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.215298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.215650] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.215889] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.216037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.216295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.216295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.216831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.216831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.216831] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.279015] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 763e51c7-31a6-4297-a43a-d679ef104eb6 [ 992.279457] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.279586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.279624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.280049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.280049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.280116] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:763e51c7-31a6-4297-a43a-d679ef104eb6 already deleted. [ 992.280177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-763e51c7-31a6-4297-a43a-d679ef104eb6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.719554] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada686fd-cb59-44cf-975b-4402d84546e6 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.719715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.719789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.720019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.720265] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.720330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.720365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.720497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.720587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.720673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.720818] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada686fd-cb59-44cf-975b-4402d84546e6 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.720915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.720974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.721175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.721313] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.721405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.721463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.721596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.721670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.721751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.721862] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.223682] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ada686fd-cb59-44cf-975b-4402d84546e6: rpc.has_security_group_logging(os_id): False [ 993.244268] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.244412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.244476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.245341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.245341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.245341] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.245341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.245341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.245341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.245587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.245667] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.245803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.245886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.246374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.246476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.246781] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.246989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.247099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.247443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.247523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.247717] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ada686fd-cb59-44cf-975b-4402d84546e6 is going to be created. [ 993.296903] env[65899]: INFO networking_nsxv3.common.synchronization [req-7fffd146-a6af-4c5a-9d33-d6caf00f7694 req-e95d7468-901a-4066-9056-a001dea4207a tempest-ImagesOneServerNegativeTestJSON-1508153592 tempest-ImagesOneServerNegativeTestJSON-1508153592-project-member] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 993.296903] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 993.297446] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.297805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.298078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.300705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.300705] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.300705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.300705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.300705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.300705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.300705] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.311982] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.311982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.311982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.314017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.314017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.327617] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada686fd-cb59-44cf-975b-4402d84546e6 in Status: IN_PROGRESS for 2s [ 993.463058] env[65899]: INFO networking_nsxv3.common.synchronization [None req-600bce83-41f9-4cc5-aab3-e7d47269649c tempest-ServerRescueNegativeTestJSON-46823991 tempest-ServerRescueNegativeTestJSON-46823991-project-member] Enqueued Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_rules [ 993.463585] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_rules [ 993.463889] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a32a98c-e183-4d24-a064-a30e3d8451a7 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.467925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.468097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.468398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.468479] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.605534] env[65899]: INFO networking_nsxv3.common.synchronization [None req-ee80a076-9c5d-4670-8d09-83729a44b88e tempest-ServerRescueNegativeTestJSON-46823991 tempest-ServerRescueNegativeTestJSON-46823991-project-member] Enqueued Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_rules [ 993.606171] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_rules [ 993.606613] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a32a98c-e183-4d24-a064-a30e3d8451a7 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.606850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.666174] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.666402] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.666536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.666871] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.667345] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.667479] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.667562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.668208] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.668376] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.668593] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.668701] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.668803] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.668903] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.669022] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.669159] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.669846] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.696037] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.696037] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.696037] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.696267] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-238" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.696572] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.697573] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.697573] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.697573] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.697573] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.747692] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 993.747950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.748704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.748704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.748704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.748704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.748704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.748909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.748955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.749077] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.803027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.803027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.803027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.803027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.823383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.823643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.823907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.823986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.824185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.824265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.824356] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 993.852460] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.852563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.852612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.853442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.853698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.866778] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 993.990042] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.990356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.990434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.990639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.990724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.990820] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 already deleted. [ 993.990901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.991070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.991219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.991298] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.199780] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.200131] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.200309] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.200611] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.200765] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.200991] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9 not found, creating... [ 994.201306] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.201400] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.201511] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.201779] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.201893] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.202292] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.202497] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.202748] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.202851] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.203011] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.203193] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9 is going to be created. [ 994.227768] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.228152] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.228152] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.228488] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.230025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.230025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.251498] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.251682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.251753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.252443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.252443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.252443] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.252674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.252674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.252800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.252800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.253102] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be updated. [ 994.311557] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.311768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.311810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.312105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.312199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.324308] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: IN_PROGRESS for 2s [ 994.514950] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.515158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.515203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.515395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.515491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.515620] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 already deleted. [ 994.515830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.965223] env[65899]: INFO networking_nsxv3.common.synchronization [req-7fffd146-a6af-4c5a-9d33-d6caf00f7694 req-70089c33-d080-442c-93dd-34baac286a3b service nova] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_rules [ 994.965375] env[65899]: INFO networking_nsxv3.common.synchronization [req-7fffd146-a6af-4c5a-9d33-d6caf00f7694 req-70089c33-d080-442c-93dd-34baac286a3b service nova] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 994.965527] env[65899]: INFO networking_nsxv3.common.synchronization [req-7fffd146-a6af-4c5a-9d33-d6caf00f7694 req-70089c33-d080-442c-93dd-34baac286a3b service nova] Enqueued Resource ID: 7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9 with Priority: HIGHEST for action port [ 994.966120] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_rules [ 994.966259] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 994.966355] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9 with Priority: HIGHEST for action port [ 994.966656] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.966723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.966909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.966982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.967281] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.968138] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.968236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.969133] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.969133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.969133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.969133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.969133] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.355242] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ada686fd-cb59-44cf-975b-4402d84546e6 in Status: SUCCESS [ 995.355539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.471454] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.471673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.472193] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9 with status ACTIVE [ 995.472266] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.472785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.472785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.472785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.473351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.473351] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.473615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.473615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.473839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.474068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.474282] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.474439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.475229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.475229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.475229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.475229] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9 is going to be updated. [ 995.506984] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.507169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.507241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.507507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.507692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.507860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ab4d0f9-2b32-4208-8a28-c1b4f5ae82c9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.877532] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 995.877650] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 deletion is rescheduled due to dependency. [ 995.877772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.878058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.878280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.878502] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.878810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.878810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.878955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.879019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.879123] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.018697] env[65899]: INFO networking_nsxv3.common.synchronization [req-4f7b2341-02dc-43f3-a381-c55519fe61f3 req-4f0e55fc-fe2f-4fcb-87bb-93794e9f95c7 tempest-ImagesNegativeTestJSON-1003871092 tempest-ImagesNegativeTestJSON-1003871092-project-member] Enqueued Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGHEST for action security_group_members [ 996.019318] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGHEST for action security_group_members [ 996.019653] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad542a16-77ff-4002-b217-5630a01b6f17 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.019791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.019861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.020080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.020233] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.020335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.020396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.020568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.020843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.020843] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.159245] env[65899]: INFO networking_nsxv3.common.synchronization [req-e6d474ad-7bbc-40e9-b012-5f8992008a09 req-57343615-b324-4255-a772-efafc5be23b1 tempest-ServersV294TestFqdnHostnames-376433348 tempest-ServersV294TestFqdnHostnames-376433348-project-member] Enqueued Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_members [ 996.159912] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_members [ 996.160348] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-35157e46-cf93-4f9c-919b-4023c4f96551 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.160592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.160742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.161080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.161341] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.161554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.161697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.161944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.162130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.162295] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.337752] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 in Status: SUCCESS [ 996.338152] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 deletion is rescheduled due to dependency. [ 996.338449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.382686] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.518723] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-311 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.518985] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-311" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.519138] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-311" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.519452] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-311" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.519710] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.519860] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.520326] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.520326] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.520469] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.520588] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.520697] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.520814] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.520897] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.520998] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.521109] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.521239] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.523125] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.523244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.523299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.523444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.523521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.523690] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.523775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.523991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.523991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.524083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.524130] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad542a16-77ff-4002-b217-5630a01b6f17 is going to be updated. [ 996.543282] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.543624] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.543825] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.544034] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-311" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.544511] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-77b4375c-566c-4eaf-b7c6-e471c0e09876 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.544771] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-77b4375c-566c-4eaf-b7c6-e471c0e09876" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.544983] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-77b4375c-566c-4eaf-b7c6-e471c0e09876" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.545392] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-77b4375c-566c-4eaf-b7c6-e471c0e09876" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.545625] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b4375c-566c-4eaf-b7c6-e471c0e09876',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.556509] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.556509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.556509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.556725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.557213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.566202] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad542a16-77ff-4002-b217-5630a01b6f17 in Status: IN_PROGRESS for 2s [ 996.664052] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.664235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.664273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.664497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.664583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.665606] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.665606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.665606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.665606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.665606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.665606] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35157e46-cf93-4f9c-919b-4023c4f96551 already deleted. [ 996.665606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.885405] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.048645] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.049119] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.049274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.049561] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.049706] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.049861] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 77b4375c-566c-4eaf-b7c6-e471c0e09876 not found, creating... [ 997.050495] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.050495] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.050637] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.050780] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.050916] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.051220] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.051376] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.051872] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.051872] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.051872] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.052026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 77b4375c-566c-4eaf-b7c6-e471c0e09876 is going to be created. [ 997.073910] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.074177] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.074347] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.074623] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.074878] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.075181] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-77b4375c-566c-4eaf-b7c6-e471c0e09876" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.388190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.388190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.388190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.388190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.388708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.388708] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 997.418490] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.418586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.418659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.418883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.419097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.429201] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 997.812132] env[65899]: INFO networking_nsxv3.common.synchronization [req-e6d474ad-7bbc-40e9-b012-5f8992008a09 req-0f4f0be3-85c2-4546-975b-8b4cea25f0fd service nova] Enqueued Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_rules [ 997.812332] env[65899]: INFO networking_nsxv3.common.synchronization [req-e6d474ad-7bbc-40e9-b012-5f8992008a09 req-0f4f0be3-85c2-4546-975b-8b4cea25f0fd service nova] Enqueued Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_members [ 997.812433] env[65899]: INFO networking_nsxv3.common.synchronization [req-e6d474ad-7bbc-40e9-b012-5f8992008a09 req-0f4f0be3-85c2-4546-975b-8b4cea25f0fd service nova] Enqueued Resource ID: 77b4375c-566c-4eaf-b7c6-e471c0e09876 with Priority: HIGHEST for action port [ 997.813014] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_rules [ 997.813821] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_members [ 997.813932] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b4375c-566c-4eaf-b7c6-e471c0e09876 with Priority: HIGHEST for action port [ 997.814238] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35157e46-cf93-4f9c-919b-4023c4f96551 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.814359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.814618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.814856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.814941] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.817158] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-35157e46-cf93-4f9c-919b-4023c4f96551 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.817286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.817391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.817589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.820305] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.820305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.820305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.820305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.820305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.820305] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.820849] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-77b4375c-566c-4eaf-b7c6-e471c0e09876 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.820849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77b4375c-566c-4eaf-b7c6-e471c0e09876" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.820849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77b4375c-566c-4eaf-b7c6-e471c0e09876" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.820964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77b4375c-566c-4eaf-b7c6-e471c0e09876" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.820997] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b4375c-566c-4eaf-b7c6-e471c0e09876',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.959093] env[65899]: INFO networking_nsxv3.common.synchronization [req-ee1d1b3b-a0d3-4970-a68e-d1c40bc65b6f req-7afec018-f8e0-4d8e-b5d6-31738a58960d tempest-MigrationsAdminTest-1684116011 tempest-MigrationsAdminTest-1684116011-project-member] Enqueued Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 997.959961] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 with Priority: HIGHEST for action security_group_members [ 997.959961] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9813fef-8c97-4cb6-92ff-4d01107ef382 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.960126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.960126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.960295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.961063] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.961063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.961063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.961063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.961250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.961250] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9813fef-8c97-4cb6-92ff-4d01107ef382',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.324577] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.324577] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-35157e46-cf93-4f9c-919b-4023c4f96551 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.324577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.324577] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77b4375c-566c-4eaf-b7c6-e471c0e09876 with status ACTIVE [ 998.324891] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.324891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.324985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.325196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.325292] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.325466] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.325563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.325623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.325789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.325894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.326189] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.326253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.327057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.327057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.327057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.327057] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77b4375c-566c-4eaf-b7c6-e471c0e09876 is going to be updated. [ 998.356584] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.356674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.356674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.356888] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.357017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.357215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77b4375c-566c-4eaf-b7c6-e471c0e09876" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.465915] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.466397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.468187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.468187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.511849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.512129] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.512248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.512315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.512521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.512602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.512712] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 is going to be updated. [ 998.547587] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.547754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.547829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.548057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.548229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.558361] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: IN_PROGRESS for 2s [ 998.583978] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad542a16-77ff-4002-b217-5630a01b6f17 in Status: SUCCESS [ 998.584178] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad542a16-77ff-4002-b217-5630a01b6f17 deletion is rescheduled due to dependency. [ 998.584298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.828463] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.857223] env[65899]: INFO networking_nsxv3.common.synchronization [req-e26d2bf8-c9a1-4556-b4fa-256989d4eafe req-0b78788c-1eea-491f-a123-9eb6d72dd306 tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 998.858016] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 998.859956] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.860170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.860899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.861366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.861482] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.861610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.861667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.861844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.861925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.862029] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.331049] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.331246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.331306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.331542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.331730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.331830] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35157e46-cf93-4f9c-919b-4023c4f96551 is going to be created. [ 999.363984] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.371705] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.371809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.371916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.372100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.372394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.387213] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35157e46-cf93-4f9c-919b-4023c4f96551 in Status: UNINITIALIZED for 2s [ 999.440986] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 999.440986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.440986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.440986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.441292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.441382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.441444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.441605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.441677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.441758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.441841] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.867146] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.947021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.947021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.947021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.947021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.947021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.947703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.947703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.947703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.947703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.948954] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.370351] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.370351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.370351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.370351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.370351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.370729] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 1000.397380] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.397566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.397629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.397806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.397948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.410274] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 1000.450666] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 698ff167-530f-4085-8a98-c574783d5ed9: rpc.has_security_group_logging(os_id): False [ 1000.470166] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.470362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.470362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.470593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.470710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.470868] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.470961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.471164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.471234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.471280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.471476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.471731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.471731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.471815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.471815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.472301] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.472301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.472301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.472301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.472446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.472446] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 1000.539981] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.539981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.539981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.539981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.539981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.560596] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 1000.570087] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 in Status: SUCCESS [ 1000.570281] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9813fef-8c97-4cb6-92ff-4d01107ef382 deletion is rescheduled due to dependency. [ 1000.570396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9813fef-8c97-4cb6-92ff-4d01107ef382" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.400707] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35157e46-cf93-4f9c-919b-4023c4f96551 in Status: SUCCESS [ 1001.401025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.401146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.401357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.401604] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.401668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.401708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.401849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.401923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.402012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.402105] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.906158] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.409416] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35157e46-cf93-4f9c-919b-4023c4f96551: rpc.has_security_group_logging(os_id): False [ 1002.422079] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 1002.422318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.427177] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.427313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.427372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.427573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.427656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.427900] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.428013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.428089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.428241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.428317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.428405] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35157e46-cf93-4f9c-919b-4023c4f96551 is going to be created. [ 1002.489090] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.489090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.489090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.489314] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.489465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.500502] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35157e46-cf93-4f9c-919b-4023c4f96551 in Status: IN_PROGRESS for 2s [ 1002.595168] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 1002.595491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.063495] env[65899]: INFO networking_nsxv3.common.synchronization [req-c2cf9720-4547-45e3-b779-63604f21a385 req-8d4561c2-7813-4779-bf58-9cca3c30d406 tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_members [ 1003.063588] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_members [ 1003.063864] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8701ee7-7415-4cf0-b1a2-be123eab71e4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.063985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.064105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.064490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.064548] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.064606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.064677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.064818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.064923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.065035] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.509315] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.509315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.509315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.509315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.509315] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.509315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.509315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.509315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.509315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.509315] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.509315] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.509315] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.509315] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.510152] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.510152] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.510152] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.529129] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.529624] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.529624] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.529905] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.530380] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-f4070474-ac94-44fa-9710-0d2bd9b4b046 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.530755] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-f4070474-ac94-44fa-9710-0d2bd9b4b046" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.530875] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-f4070474-ac94-44fa-9710-0d2bd9b4b046" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.532021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-f4070474-ac94-44fa-9710-0d2bd9b4b046" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.532021] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4070474-ac94-44fa-9710-0d2bd9b4b046',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.567100] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.567303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.567371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.567668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.567782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.568046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.568161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.568225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.568440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.568525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.568617] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 already deleted. [ 1003.568696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.033868] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.034101] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.034274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.035156] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.035156] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.035156] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port f4070474-ac94-44fa-9710-0d2bd9b4b046 not found, creating... [ 1004.035156] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.035314] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.035400] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.035624] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.035758] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.036093] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.036256] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.036374] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.036619] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.036757] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.036892] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: f4070474-ac94-44fa-9710-0d2bd9b4b046 is going to be created. [ 1004.056042] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.056267] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.056392] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.056662] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.056887] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.057118] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-f4070474-ac94-44fa-9710-0d2bd9b4b046" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.519186] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35157e46-cf93-4f9c-919b-4023c4f96551 in Status: SUCCESS [ 1004.519186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.778046] env[65899]: INFO networking_nsxv3.common.synchronization [req-c2cf9720-4547-45e3-b779-63604f21a385 req-7be04b1a-961b-41d5-bb3f-c7ebae3fdb98 service nova] Enqueued Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_rules [ 1004.778275] env[65899]: INFO networking_nsxv3.common.synchronization [req-c2cf9720-4547-45e3-b779-63604f21a385 req-7be04b1a-961b-41d5-bb3f-c7ebae3fdb98 service nova] Enqueued Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_members [ 1004.778428] env[65899]: INFO networking_nsxv3.common.synchronization [req-c2cf9720-4547-45e3-b779-63604f21a385 req-7be04b1a-961b-41d5-bb3f-c7ebae3fdb98 service nova] Enqueued Resource ID: f4070474-ac94-44fa-9710-0d2bd9b4b046 with Priority: HIGHEST for action port [ 1004.778729] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_rules [ 1004.778874] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_members [ 1004.778980] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4070474-ac94-44fa-9710-0d2bd9b4b046 with Priority: HIGHEST for action port [ 1004.779534] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.779654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.779723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.779917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.780009] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.780820] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8701ee7-7415-4cf0-b1a2-be123eab71e4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.780933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.780999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.781176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.781317] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.781410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.781470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.781624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.781681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.781755] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.783259] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4070474-ac94-44fa-9710-0d2bd9b4b046 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.783259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4070474-ac94-44fa-9710-0d2bd9b4b046" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.783259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4070474-ac94-44fa-9710-0d2bd9b4b046" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.783259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4070474-ac94-44fa-9710-0d2bd9b4b046" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.783259] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4070474-ac94-44fa-9710-0d2bd9b4b046',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.284951] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8701ee7-7415-4cf0-b1a2-be123eab71e4 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.285140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.285413] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.286548] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4070474-ac94-44fa-9710-0d2bd9b4b046 with status ACTIVE [ 1005.287267] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.287267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.287267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.287606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.287761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.288082] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.288858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.288858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.288858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.288858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.288858] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.289320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.289320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.289473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.289473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.290216] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4070474-ac94-44fa-9710-0d2bd9b4b046 is going to be updated. [ 1005.317151] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.317519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.317623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.317917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.318135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.318345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4070474-ac94-44fa-9710-0d2bd9b4b046" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.656734] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-6765c0f7-ba7c-4d78-9ceb-9e42bc3ed1f8 tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1005.657367] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1005.657745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.658049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.658049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.658328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.658518] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.658669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.658735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.658870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.658979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.659119] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.793877] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.064703] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-271a8a46-dab0-4e42-aa8f-4efa911ff348 tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1006.065503] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1006.065827] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.065933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.164529] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.164704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.164777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.165072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.165215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.165362] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.165471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.165550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.165703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.165777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.165862] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 already deleted. [ 1006.165939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.166139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.166280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.166418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.166508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.166578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.166691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.166762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.166851] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.296054] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.296234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.296298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.296602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.296730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.296835] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 is going to be created. [ 1006.321163] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.321332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.321448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.321877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.322570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.328818] env[65899]: INFO networking_nsxv3.common.synchronization [req-85395a51-fa47-49e8-bc0a-e018713f0eed req-306bd022-bc24-430b-8769-54f9fd961112 tempest-ImagesOneServerNegativeTestJSON-1508153592 tempest-ImagesOneServerNegativeTestJSON-1508153592-project-member] Enqueued Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 1006.329387] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 698ff167-530f-4085-8a98-c574783d5ed9 with Priority: HIGHEST for action security_group_members [ 1006.329695] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-698ff167-530f-4085-8a98-c574783d5ed9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.330597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.330597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.330597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.330747] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.330747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.330858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.331216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.331216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.331216] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('698ff167-530f-4085-8a98-c574783d5ed9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.336698] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 in Status: UNINITIALIZED for 2s [ 1006.477355] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-6fd30774-d6b4-4da4-8c9e-afb32cc3576d tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1006.477900] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1006.478225] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.478336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.670382] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.670382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.670382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.670761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.670761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.670822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.670894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.672030] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 already deleted. [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.672030] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.672030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.672427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.672427] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.799732] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-816 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.799732] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-816" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.799732] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-816" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.800077] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-816" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.800341] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.800506] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.800732] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.800961] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.801620] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.801942] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.802244] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.802457] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.802619] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.803401] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.803684] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.803887] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.829157] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.829157] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.829271] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.830047] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-816" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.830047] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-892a2eda-acf1-4021-b422-576dd2e6d874 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.830047] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-892a2eda-acf1-4021-b422-576dd2e6d874" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.830047] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-892a2eda-acf1-4021-b422-576dd2e6d874" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.830904] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-892a2eda-acf1-4021-b422-576dd2e6d874" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.830904] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('892a2eda-acf1-4021-b422-576dd2e6d874',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.835633] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.835765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.835917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.836252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.836354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.837042] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.837042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.837042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.837042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.837042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.837251] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 is going to be updated. [ 1006.888429] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.888724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.888724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.888911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.889081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.903303] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: IN_PROGRESS for 2s [ 1007.175297] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.175544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.175645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.175896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.176044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.176388] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.176734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.176734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.176852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.176887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.176973] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 already deleted. [ 1007.177073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.333914] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.334154] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.334249] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.334951] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.335256] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.335458] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 892a2eda-acf1-4021-b422-576dd2e6d874 not found, creating... [ 1007.335812] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.336033] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.336197] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.336498] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.336661] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.337021] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.337356] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.337579] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.337885] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.338016] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.338190] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 892a2eda-acf1-4021-b422-576dd2e6d874 is going to be created. [ 1007.362696] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.362696] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.362696] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.363332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.363635] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.363882] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-892a2eda-acf1-4021-b422-576dd2e6d874" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.127914] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-81b59b67-cf25-4d02-8999-170b6ff7f178 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1008.128265] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-81b59b67-cf25-4d02-8999-170b6ff7f178 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1008.128573] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-81b59b67-cf25-4d02-8999-170b6ff7f178 service nova] Enqueued Resource ID: 892a2eda-acf1-4021-b422-576dd2e6d874 with Priority: HIGHEST for action port [ 1008.129342] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1008.129485] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1008.129579] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 892a2eda-acf1-4021-b422-576dd2e6d874 with Priority: HIGHEST for action port [ 1008.129868] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.131050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.131091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.131371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.131440] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.132501] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.132560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.132624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.132804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.132959] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.133065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.133124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.133257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.133459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.133553] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.135603] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-892a2eda-acf1-4021-b422-576dd2e6d874 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.135800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-892a2eda-acf1-4021-b422-576dd2e6d874" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.135903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-892a2eda-acf1-4021-b422-576dd2e6d874" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.136147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-892a2eda-acf1-4021-b422-576dd2e6d874" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.136251] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('892a2eda-acf1-4021-b422-576dd2e6d874',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.347899] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 in Status: SUCCESS [ 1008.348182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.348379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.348613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.348807] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.348937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.349009] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.349186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.349278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.350040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.350040] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.638766] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.639959] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.640085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.640256] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 892a2eda-acf1-4021-b422-576dd2e6d874 with status ACTIVE [ 1008.640621] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.640621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.640621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.640786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.641392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.641392] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.641392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.641392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.641392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.641392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.641660] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.641660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.641738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.641835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.643746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.643856] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 892a2eda-acf1-4021-b422-576dd2e6d874 is going to be updated. [ 1008.672370] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.672522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.672608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.672806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.673146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.673311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-892a2eda-acf1-4021-b422-576dd2e6d874" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.851726] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.915103] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 698ff167-530f-4085-8a98-c574783d5ed9 in Status: SUCCESS [ 1008.915473] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 698ff167-530f-4085-8a98-c574783d5ed9 deletion is rescheduled due to dependency. [ 1008.915473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-698ff167-530f-4085-8a98-c574783d5ed9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.979377] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.979578] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-201" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.979699] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-201" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.980035] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-201" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.980307] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.980466] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.981876] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.981876] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.981876] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.981876] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.981876] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.981876] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.981876] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.981876] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.981876] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.981876] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.005488] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.005488] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.005681] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.006103] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-201" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.006468] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.006468] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.006603] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.006936] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.007457] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aeb3ce3d-518c-41e3-a91c-d4b70e89a52a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.145964] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.355849] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8701ee7-7415-4cf0-b1a2-be123eab71e4: rpc.has_security_group_logging(os_id): False [ 1009.382316] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.382460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.382530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.382742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.382844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.383439] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.383555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.383621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.386545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.386545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.386545] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 is going to be created. [ 1009.466857] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.467013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.467063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.467380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.467639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.500099] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 in Status: IN_PROGRESS for 2s [ 1009.510524] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.513587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.513587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.513587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.513587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.513587] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port aeb3ce3d-518c-41e3-a91c-d4b70e89a52a not found, creating... [ 1009.513587] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.513587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.513587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.513587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.514062] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.514771] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.514771] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.515033] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.515277] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.515483] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.515721] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: aeb3ce3d-518c-41e3-a91c-d4b70e89a52a is going to be created. [ 1009.546331] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.546577] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.546724] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.547183] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.547544] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.547847] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.648382] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.648684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.648684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.648832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.648956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.649159] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be created. [ 1009.698901] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.698901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.699261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.700421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.700421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.718638] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: UNINITIALIZED for 2s [ 1010.266232] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-de2006d1-9c33-4d55-9fac-8f89931e8579 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1010.266232] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-de2006d1-9c33-4d55-9fac-8f89931e8579 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1010.266232] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-de2006d1-9c33-4d55-9fac-8f89931e8579 service nova] Enqueued Resource ID: aeb3ce3d-518c-41e3-a91c-d4b70e89a52a with Priority: HIGHEST for action port [ 1010.266232] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1010.266232] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1010.266869] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeb3ce3d-518c-41e3-a91c-d4b70e89a52a with Priority: HIGHEST for action port [ 1010.266869] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.266869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.267146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.267146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.267274] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.267502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.267502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.267626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.267704] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aeb3ce3d-518c-41e3-a91c-d4b70e89a52a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.483526] env[65899]: INFO networking_nsxv3.common.synchronization [req-8123335e-df58-42e4-934d-5e7e5904963a req-09954a8b-b769-4ec0-926b-551eee9971b7 tempest-ServersWithSpecificFlavorTestJSON-353865173 tempest-ServersWithSpecificFlavorTestJSON-353865173-project-member] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 1010.483526] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGHEST for action security_group_members [ 1010.484511] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.484511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.484511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.484511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.484511] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.484511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.484860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.484860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.484938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.485069] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.771183] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aeb3ce3d-518c-41e3-a91c-d4b70e89a52a with status ACTIVE [ 1010.771419] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.773307] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.773307] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.773307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.773307] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aeb3ce3d-518c-41e3-a91c-d4b70e89a52a is going to be updated. [ 1010.794463] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.794626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.794626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.794823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.794993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.795160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aeb3ce3d-518c-41e3-a91c-d4b70e89a52a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.988010] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.988194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.988268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.988477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.988565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.988759] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.988862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.988912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.989072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.989151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.989238] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be updated. [ 1011.025416] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.025573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.025646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.025838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.026000] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.035537] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: IN_PROGRESS for 2s [ 1011.142523] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-816 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.142748] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-816" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.143302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-816" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.143668] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-816" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.144069] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.144617] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.144722] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.145170] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.145753] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.145917] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.146166] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.146426] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.146426] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.146557] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.146655] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.146831] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.180363] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.180607] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.180678] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.180863] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-816" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.181211] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-b47fe05d-ff56-48db-b678-bfe518a81f63 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.181381] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-b47fe05d-ff56-48db-b678-bfe518a81f63" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.181503] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-b47fe05d-ff56-48db-b678-bfe518a81f63" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.181972] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-b47fe05d-ff56-48db-b678-bfe518a81f63" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.181972] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47fe05d-ff56-48db-b678-bfe518a81f63',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.516333] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 in Status: SUCCESS [ 1011.516333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.687021] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.687021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.687021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.687021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.687021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.687021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port b47fe05d-ff56-48db-b678-bfe518a81f63 not found, creating... [ 1011.687021] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.687021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.687021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.687021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.687021] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.687477] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.687477] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.687477] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.688351] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.688562] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.688760] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: b47fe05d-ff56-48db-b678-bfe518a81f63 is going to be created. [ 1011.716024] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.716024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.716024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.716024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.716024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.716024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-b47fe05d-ff56-48db-b678-bfe518a81f63" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.729262] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1011.729532] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.729736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.729981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.730378] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.730461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.730499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.730754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.730801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.730966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.731532] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.733543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.735021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.735021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.735021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.735021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.735021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.735021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.735021] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.237792] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.237792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.237792] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.434777] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-3fac73c2-a797-4f3c-a901-68996eccfd87 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1012.436119] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-3fac73c2-a797-4f3c-a901-68996eccfd87 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1012.436119] env[65899]: INFO networking_nsxv3.common.synchronization [req-8a0bafcd-6747-4bf3-8a61-3d40ce1b0578 req-3fac73c2-a797-4f3c-a901-68996eccfd87 service nova] Enqueued Resource ID: b47fe05d-ff56-48db-b678-bfe518a81f63 with Priority: HIGHEST for action port [ 1012.436603] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1012.436791] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1012.437156] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b47fe05d-ff56-48db-b678-bfe518a81f63 with Priority: HIGHEST for action port [ 1012.439315] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.439315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.439315] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.439315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.439315] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b47fe05d-ff56-48db-b678-bfe518a81f63 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.439315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b47fe05d-ff56-48db-b678-bfe518a81f63" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.439315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b47fe05d-ff56-48db-b678-bfe518a81f63" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.439315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b47fe05d-ff56-48db-b678-bfe518a81f63" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.439315] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b47fe05d-ff56-48db-b678-bfe518a81f63',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.739138] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.943309] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b47fe05d-ff56-48db-b678-bfe518a81f63 with status ACTIVE [ 1012.943309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.943309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.943309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.943309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.943309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.943309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.943309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.943309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.943309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.943309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.943834] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.943834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.943834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.943834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.943834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.944056] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b47fe05d-ff56-48db-b678-bfe518a81f63 is going to be updated. [ 1012.969597] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.969751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.969811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.970026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.970158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.970313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b47fe05d-ff56-48db-b678-bfe518a81f63" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.046639] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 in Status: SUCCESS [ 1013.046639] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 deletion is rescheduled due to dependency. [ 1013.046639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.245054] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.245257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.245301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.245519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.245613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.245709] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1013.280643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.280957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.280957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.281114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.281254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.292461] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1014.686589] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.687208] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.687208] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.687208] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.689039] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.689039] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.689039] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.689039] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.689039] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.689039] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.689039] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.689039] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.689039] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.689039] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.689039] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.689039] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.726681] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.726853] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1014.727010] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.727199] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.727590] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-bda76f95-db13-4c1e-b09f-44486bb22dea taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.727776] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.727915] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.728204] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.728356] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda76f95-db13-4c1e-b09f-44486bb22dea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.234037] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.234280] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.234454] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.234854] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.235089] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.235514] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.235730] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.235910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.236292] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.236509] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.236927] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.237168] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.237339] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.237649] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.237842] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.238053] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: bda76f95-db13-4c1e-b09f-44486bb22dea is going to be updated. [ 1015.262492] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.262701] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.262823] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.263298] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.263509] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.263763] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.302591] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1015.302809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.302984] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.303227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.303425] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.303543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.303607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.303764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.303843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.303927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.305988] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.305988] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.305988] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.305988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.306573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.306573] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.306573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.306573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.306688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.306688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.306737] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.808882] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2db7096a-5721-4998-9040-4834cd315121: rpc.has_security_group_logging(os_id): False [ 1015.810079] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.828054] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.828242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.828303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.828553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.828655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.828874] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.828973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.829049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.829199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.829273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.829473] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.829580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.829653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.829871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.829953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.830280] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.830405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.830479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.830628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.830702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.830786] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be created. [ 1015.918915] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.919830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.920021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.920428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.920654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.932254] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1015.970203] env[65899]: INFO networking_nsxv3.common.synchronization [req-ceafef7a-938a-4f05-ad2f-779ff4c32845 req-bde3e856-8057-4606-98b2-3bac762471a4 service nova] Enqueued Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_rules [ 1015.970203] env[65899]: INFO networking_nsxv3.common.synchronization [req-ceafef7a-938a-4f05-ad2f-779ff4c32845 req-bde3e856-8057-4606-98b2-3bac762471a4 service nova] Enqueued Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_members [ 1015.970379] env[65899]: INFO networking_nsxv3.common.synchronization [req-ceafef7a-938a-4f05-ad2f-779ff4c32845 req-bde3e856-8057-4606-98b2-3bac762471a4 service nova] Enqueued Resource ID: bda76f95-db13-4c1e-b09f-44486bb22dea with Priority: HIGHEST for action port [ 1015.970841] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_rules [ 1015.971047] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_members [ 1015.971176] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda76f95-db13-4c1e-b09f-44486bb22dea with Priority: HIGHEST for action port [ 1015.971445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.971599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.971631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.971827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.971897] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.973277] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.973424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.974316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.974316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.974316] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.974316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.974316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.974316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.974316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.974316] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.974999] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-bda76f95-db13-4c1e-b09f-44486bb22dea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.975596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.975596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.975817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.975890] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda76f95-db13-4c1e-b09f-44486bb22dea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.312387] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.474597] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.474755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.481461] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bda76f95-db13-4c1e-b09f-44486bb22dea with status ACTIVE [ 1016.481461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.481461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.481461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.481461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.481461] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bda76f95-db13-4c1e-b09f-44486bb22dea is going to be updated. [ 1016.482149] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.510771] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.510953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.511030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.511293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.511440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.511641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bda76f95-db13-4c1e-b09f-44486bb22dea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.816833] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.817224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.817224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.817401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.817500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.817616] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1016.853962] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.854155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.854155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.854369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.854511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.884766] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1016.985408] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.488328] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.488498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.488567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.488805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.488911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.489033] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f is going to be updated. [ 1017.523968] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.523968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.523968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.523968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.524256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.534821] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: IN_PROGRESS for 2s [ 1017.824029] env[65899]: INFO networking_nsxv3.common.synchronization [req-f68a96fc-0ec0-4e64-8953-2ccdca288555 req-901fade5-d49d-4f16-b9cf-207f47785085 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1017.824595] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1017.824903] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.825198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.825363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.825591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.825786] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.825914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.825997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.826202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.826313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.826441] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.951023] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1017.952233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.952964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.953464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.954213] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.281177] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.281437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.281601] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.281900] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.282218] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.282416] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.282560] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.282812] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.283016] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.283282] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.283557] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.283595] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.283809] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.283809] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.283903] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.284023] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.303899] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.304091] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.304229] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.304403] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.304772] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-ea53e547-03d4-4191-afce-a6b67fc4a646 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.304881] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-ea53e547-03d4-4191-afce-a6b67fc4a646" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.305034] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-ea53e547-03d4-4191-afce-a6b67fc4a646" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.305378] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-ea53e547-03d4-4191-afce-a6b67fc4a646" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.305520] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea53e547-03d4-4191-afce-a6b67fc4a646',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.330025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.330025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.330025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.330025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.330025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.330025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.330025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.330025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.330025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.330025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.330025] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1018.359710] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.359857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.359928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.360169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.360310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.371066] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1018.460139] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.460337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.808255] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.808958] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.810014] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.810014] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.810014] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.810014] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port ea53e547-03d4-4191-afce-a6b67fc4a646 not found, creating... [ 1018.810410] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.810669] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.810853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.811148] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.811295] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.811617] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.811811] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.811993] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.812410] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.812610] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.812836] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: ea53e547-03d4-4191-afce-a6b67fc4a646 is going to be created. [ 1018.841811] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.842240] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.842397] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.842746] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.842994] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.843354] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-ea53e547-03d4-4191-afce-a6b67fc4a646" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.898993] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1018.899871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.899871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.899871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.900104] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.900221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.900297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.900423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.900507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.900592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.900698] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.404321] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.404477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.404531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.405326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.405326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.405326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.405326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.405326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.405704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.405704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.405704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.405704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.405704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.405866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.406256] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.406256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.406256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.406408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.406408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.406622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.406622] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.551666] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: SUCCESS [ 1019.551666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.551666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.551666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.551666] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.551666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.551666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.551666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.551666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.551666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.551666] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.584780] env[65899]: INFO networking_nsxv3.common.synchronization [req-f68a96fc-0ec0-4e64-8953-2ccdca288555 req-ec456af1-151b-4c5f-890b-a0fb339dc2c6 service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 1019.584986] env[65899]: INFO networking_nsxv3.common.synchronization [req-f68a96fc-0ec0-4e64-8953-2ccdca288555 req-ec456af1-151b-4c5f-890b-a0fb339dc2c6 service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1019.585249] env[65899]: INFO networking_nsxv3.common.synchronization [req-f68a96fc-0ec0-4e64-8953-2ccdca288555 req-ec456af1-151b-4c5f-890b-a0fb339dc2c6 service nova] Enqueued Resource ID: ea53e547-03d4-4191-afce-a6b67fc4a646 with Priority: HIGHEST for action port [ 1019.587031] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 1019.587031] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1019.587031] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea53e547-03d4-4191-afce-a6b67fc4a646 with Priority: HIGHEST for action port [ 1019.587031] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.587533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.587533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.587533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.587533] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.588488] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.588575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.588757] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea53e547-03d4-4191-afce-a6b67fc4a646 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.588853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea53e547-03d4-4191-afce-a6b67fc4a646" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.589388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea53e547-03d4-4191-afce-a6b67fc4a646" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.589586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea53e547-03d4-4191-afce-a6b67fc4a646" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.589662] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea53e547-03d4-4191-afce-a6b67fc4a646',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.910334] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2db7096a-5721-4998-9040-4834cd315121: rpc.has_security_group_logging(os_id): False [ 1019.933011] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.933213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.933345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.933596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.933757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.934114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.934114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.934268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.934461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.934461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.934645] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.934720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.934824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.934922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.934985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.935312] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.935431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.935603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.935678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.935776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.935899] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1020.011537] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.011694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.011765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.011971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.012120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.026810] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1020.054393] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.092647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.092797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.092936] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea53e547-03d4-4191-afce-a6b67fc4a646 with status ACTIVE [ 1020.093118] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.093294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.093354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.093597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.093689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.093882] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.093979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.094087] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.094257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.094360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.094583] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.094718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.094758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.094887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.095022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.095091] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea53e547-03d4-4191-afce-a6b67fc4a646 is going to be updated. [ 1020.123446] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.123631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.123708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.124047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.124084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.124221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea53e547-03d4-4191-afce-a6b67fc4a646" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.381024] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1020.381217] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b deletion is rescheduled due to dependency. [ 1020.381330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.382195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.382195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.382195] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.382195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.382195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.382195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.382533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.382533] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.490916] env[65899]: INFO networking_nsxv3.common.synchronization [req-ef634c09-a4c3-4d5d-8d0a-4b6848628260 req-b7f39a22-7be4-4ce7-8d57-ed128deb69db tempest-ServersAdminTestJSON-2084545516 tempest-ServersAdminTestJSON-2084545516-project-member] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1020.493634] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1020.493990] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.494136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.494227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.494443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.494613] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.494750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.494829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.494911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.494992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.495130] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.556927] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e8e18e2-41de-44dd-a97f-655de1cca16f: rpc.has_security_group_logging(os_id): False [ 1020.576519] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.576665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.576741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.576986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.598746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.599121] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.599417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.599417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.599589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.599589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.599715] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f is going to be updated. [ 1020.668676] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.668868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.668868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.669129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.669332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.684132] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: IN_PROGRESS for 2s [ 1020.884236] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.997281] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.329190] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.329190] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.329190] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.329606] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.330030] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.330402] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.330685] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.333483] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.333483] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.333483] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.333483] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.333483] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.333483] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.333483] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.333483] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.333483] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.354253] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.354356] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.354417] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.354596] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.354910] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-9b829bbe-7671-47f2-aafe-975ae5950b69 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.355125] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-9b829bbe-7671-47f2-aafe-975ae5950b69" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.355353] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-9b829bbe-7671-47f2-aafe-975ae5950b69" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.355580] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-9b829bbe-7671-47f2-aafe-975ae5950b69" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.355737] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b829bbe-7671-47f2-aafe-975ae5950b69',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.386995] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.500965] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.859603] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.859603] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.860108] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.860108] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.860300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.860408] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 9b829bbe-7671-47f2-aafe-975ae5950b69 not found, creating... [ 1021.861032] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.861032] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.861216] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.861855] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.861855] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.861966] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.862764] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.862764] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.862764] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.862764] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.862764] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 9b829bbe-7671-47f2-aafe-975ae5950b69 is going to be created. [ 1021.887228] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.887432] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.887560] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.887842] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.888101] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.888325] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-9b829bbe-7671-47f2-aafe-975ae5950b69" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.894040] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.894040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.894040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.894040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.894040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.894040] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1021.964396] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.964614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.964706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.965012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.966041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.979259] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1022.004114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.004515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.004515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.004600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.004661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.004708] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1022.042406] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1022.042681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.042904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.043216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.043329] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.059950] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.060154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.060215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.060465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.060798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.081811] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1022.545567] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.545869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.545950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.546238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.546445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.546734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.546734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.546908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.547000] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.547106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.547203] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.603273] env[65899]: INFO networking_nsxv3.common.synchronization [req-ef634c09-a4c3-4d5d-8d0a-4b6848628260 req-f79629f0-5cb1-4f18-940e-d67a212b13bc service nova] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_rules [ 1022.603426] env[65899]: INFO networking_nsxv3.common.synchronization [req-ef634c09-a4c3-4d5d-8d0a-4b6848628260 req-f79629f0-5cb1-4f18-940e-d67a212b13bc service nova] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1022.603581] env[65899]: INFO networking_nsxv3.common.synchronization [req-ef634c09-a4c3-4d5d-8d0a-4b6848628260 req-f79629f0-5cb1-4f18-940e-d67a212b13bc service nova] Enqueued Resource ID: 9b829bbe-7671-47f2-aafe-975ae5950b69 with Priority: HIGHEST for action port [ 1022.604308] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_rules [ 1022.604468] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1022.604564] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b829bbe-7671-47f2-aafe-975ae5950b69 with Priority: HIGHEST for action port [ 1022.605008] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.605349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.605398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.605675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.605675] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.606824] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.606926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.608269] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b829bbe-7671-47f2-aafe-975ae5950b69 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.608409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b829bbe-7671-47f2-aafe-975ae5950b69" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.608494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b829bbe-7671-47f2-aafe-975ae5950b69" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.608703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b829bbe-7671-47f2-aafe-975ae5950b69" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.608782] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b829bbe-7671-47f2-aafe-975ae5950b69',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.702750] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: SUCCESS [ 1022.702750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.050937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.051256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.051256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.051487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.051766] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.051939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.052075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.052331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.052536] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.052710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.052888] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.053132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.053254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.053632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.053696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.053978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.053978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.054157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.054288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.054411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.054546] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.111286] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.111461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.111646] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b829bbe-7671-47f2-aafe-975ae5950b69 with status ACTIVE [ 1023.111898] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.112041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.112395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.112425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.112498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.112712] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.112815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.112889] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.113089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.113167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.113348] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.113434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.113571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.113633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.113719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.113837] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b829bbe-7671-47f2-aafe-975ae5950b69 is going to be updated. [ 1023.159183] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.159445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.159529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.159892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.160141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.160399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b829bbe-7671-47f2-aafe-975ae5950b69" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.351213] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9696dedb-981b-424e-8e02-5aeb74ce0edd None None] Enqueued Resource ID: 6afaaac3-a189-4214-9c6f-0cd48bb7b632 with Priority: HIGHEST for action port [ 1023.351213] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6afaaac3-a189-4214-9c6f-0cd48bb7b632 with Priority: HIGHEST for action port [ 1023.354427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-6afaaac3-a189-4214-9c6f-0cd48bb7b632 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.354427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6afaaac3-a189-4214-9c6f-0cd48bb7b632" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.354427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6afaaac3-a189-4214-9c6f-0cd48bb7b632" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.354608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6afaaac3-a189-4214-9c6f-0cd48bb7b632" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.354658] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6afaaac3-a189-4214-9c6f-0cd48bb7b632',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.546777] env[65899]: INFO networking_nsxv3.common.synchronization [req-06b16182-2cb2-414b-8791-a17babba73d4 req-ca232243-1f7e-4338-84ab-290e18be31da tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1023.546777] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1023.547937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.547937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.547937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.547937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.547937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.547937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.547937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.547937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.547937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.548343] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.558781] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2db7096a-5721-4998-9040-4834cd315121: rpc.has_security_group_logging(os_id): False [ 1023.583441] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.583441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.583441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.583441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.583662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.584185] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.584185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.584185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.585299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.585299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.585299] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.585299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.585299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.585456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.585485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.585720] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.585872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.585872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.585968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.586158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.586266] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1023.660952] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.661209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.661285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.661552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.661701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.678383] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1023.857428] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6afaaac3-a189-4214-9c6f-0cd48bb7b632 [ 1023.857717] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.857867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.857867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.861061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.861061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.861061] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6afaaac3-a189-4214-9c6f-0cd48bb7b632 already deleted. [ 1023.861061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6afaaac3-a189-4214-9c6f-0cd48bb7b632" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.937966] env[65899]: INFO networking_nsxv3.common.synchronization [req-06b16182-2cb2-414b-8791-a17babba73d4 req-1a195df6-6bfc-44d9-ab96-2c9a45244dc8 tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1023.938560] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1023.938898] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.939007] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.991372] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1023.991619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.991793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.992026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.992285] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.992400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.992468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.992705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.992796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.992847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.992893] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.049625] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.096084] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1024.096084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.096084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.096084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.096084] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.096084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.096084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.096084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.096084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.096084] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.484390] env[65899]: INFO networking_nsxv3.common.synchronization [req-06b16182-2cb2-414b-8791-a17babba73d4 req-7b8fc7c6-fc2b-44b6-b967-756496d8e0e5 tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1024.484869] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1024.486537] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.486662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.497945] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.498224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.498224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.498418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.498609] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.498703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.498769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.498931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.499083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.499143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.499306] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.499457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.499457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.499611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.499757] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.499821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.499864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.499982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.500314] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.501689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.501689] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.555704] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.601146] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.003132] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b: rpc.has_security_group_logging(os_id): False [ 1025.024547] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.025827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.026014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.026285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.026392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.026628] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.026736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.026798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.026961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.027047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.027234] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.027324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.027384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.027524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.027593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.027783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.027878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.027929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.029298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.029432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.029537] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1025.058938] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.059128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.059167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.059377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.059505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.059570] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1025.090600] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.090600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.090600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.090600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.090600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.092592] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.092701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.092770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.092931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.094416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.103381] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1025.103381] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.108344] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1025.606477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.607946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.608098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.608328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.608427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.608917] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1025.641114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.641602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.641602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.641602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.642023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.652032] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1025.693089] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1025.693372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.748623] env[65899]: INFO networking_nsxv3.common.synchronization [req-0fba38ea-6a8e-4b2a-b05a-0dc68e9c9dcf req-75952164-4333-45d6-81b4-d77f5331fc59 tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1025.749253] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1025.749567] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.749776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.749776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.750656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.750656] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.750656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.750656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.750656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.750656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.750656] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.253316] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.253798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.253798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.253798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.253798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.253992] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.254118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.254176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.254328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.254397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.254488] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1026.268463] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.269107] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.269107] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.269368] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.269476] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.269865] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.269865] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.270022] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.270078] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.270258] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.270383] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.270491] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.270597] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.270746] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.270905] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.270944] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.286330] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.286676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.286746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.289859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.289859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.295950] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.295950] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.295950] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.295950] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.295950] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-2a8fa414-8783-48ca-a03c-c30b73e25cbe taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.296309] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-2a8fa414-8783-48ca-a03c-c30b73e25cbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.296309] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-2a8fa414-8783-48ca-a03c-c30b73e25cbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.297273] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-2a8fa414-8783-48ca-a03c-c30b73e25cbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.297273] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a8fa414-8783-48ca-a03c-c30b73e25cbe',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.301356] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1026.800941] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.802118] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.802118] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.802118] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.802118] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.802118] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 2a8fa414-8783-48ca-a03c-c30b73e25cbe not found, creating... [ 1026.802426] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.802524] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.802644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.802873] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.803030] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.803355] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.803515] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.803635] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.803864] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.804008] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.804150] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 2a8fa414-8783-48ca-a03c-c30b73e25cbe is going to be created. [ 1026.828582] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.828786] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.829318] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.829318] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.829467] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.830982] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-2a8fa414-8783-48ca-a03c-c30b73e25cbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.036716] env[65899]: INFO networking_nsxv3.common.synchronization [None req-f3683bee-7ab3-4572-ac7f-cb51c8d9e110 None None] Enqueued Resource ID: e7bf4670-e700-4be2-ad60-810231f56f12 with Priority: HIGHEST for action port [ 1027.037391] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7bf4670-e700-4be2-ad60-810231f56f12 with Priority: HIGHEST for action port [ 1027.037694] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7bf4670-e700-4be2-ad60-810231f56f12 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.037826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7bf4670-e700-4be2-ad60-810231f56f12" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.037892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7bf4670-e700-4be2-ad60-810231f56f12" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.038174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7bf4670-e700-4be2-ad60-810231f56f12" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.038320] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7bf4670-e700-4be2-ad60-810231f56f12',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.120062] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1027.120062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.120062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.120062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.120062] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.120062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.120062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.120062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.120062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.120062] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.135997] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1027.136291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.541116] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7bf4670-e700-4be2-ad60-810231f56f12 [ 1027.541420] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.541613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.542196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.542196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.542196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.542664] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7bf4670-e700-4be2-ad60-810231f56f12 already deleted. [ 1027.542664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7bf4670-e700-4be2-ad60-810231f56f12" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.593680] env[65899]: INFO networking_nsxv3.common.synchronization [req-0fba38ea-6a8e-4b2a-b05a-0dc68e9c9dcf req-0c8069c0-e517-40dc-8d9e-e8c98315c746 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1027.593831] env[65899]: INFO networking_nsxv3.common.synchronization [req-0fba38ea-6a8e-4b2a-b05a-0dc68e9c9dcf req-0c8069c0-e517-40dc-8d9e-e8c98315c746 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1027.593974] env[65899]: INFO networking_nsxv3.common.synchronization [req-0fba38ea-6a8e-4b2a-b05a-0dc68e9c9dcf req-0c8069c0-e517-40dc-8d9e-e8c98315c746 service nova] Enqueued Resource ID: 2a8fa414-8783-48ca-a03c-c30b73e25cbe with Priority: HIGHEST for action port [ 1027.594559] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1027.594696] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1027.594792] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a8fa414-8783-48ca-a03c-c30b73e25cbe with Priority: HIGHEST for action port [ 1027.597429] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.597429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.597429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.597429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.597429] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.599659] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.599659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.599659] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a8fa414-8783-48ca-a03c-c30b73e25cbe taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.599659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a8fa414-8783-48ca-a03c-c30b73e25cbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.599659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a8fa414-8783-48ca-a03c-c30b73e25cbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.599659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a8fa414-8783-48ca-a03c-c30b73e25cbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.600046] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a8fa414-8783-48ca-a03c-c30b73e25cbe',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.625300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.625459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.625558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.625736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.625822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.626034] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.626207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.626257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.626443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.626519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.626606] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1027.666615] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1027.666615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.667236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.667577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.667835] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.667954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.668047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.668229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.668335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.668430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.668558] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.672080] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.672212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.672212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.672412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.672648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.688416] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1028.102422] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.102594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.102763] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a8fa414-8783-48ca-a03c-c30b73e25cbe with status ACTIVE [ 1028.102957] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.103069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.103150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.103435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.103538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.103670] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.104102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.104102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.104102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.104102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.104501] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.104501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.104501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.104663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.104663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.104663] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a8fa414-8783-48ca-a03c-c30b73e25cbe is going to be updated. [ 1028.131866] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.131866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.131866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.131866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.131866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.131866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a8fa414-8783-48ca-a03c-c30b73e25cbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.175657] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.175891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.175891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.176539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.176817] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.176953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.177062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.177243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.177375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.177519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.177748] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.177855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.177919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.178289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.178682] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.178682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.178682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.178830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.178894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.178980] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.179086] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.317637] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1028.317637] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1028.317835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.317899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.318179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.318379] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.318527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.318584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.318727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.318809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.318906] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.395471] env[65899]: INFO networking_nsxv3.common.synchronization [req-f4463a7b-226d-4bc6-b264-fe62a327f54c req-ce4de87c-41ad-47b7-9375-c7e3eb4444d7 tempest-ServersNegativeTestMultiTenantJSON-634713615 tempest-ServersNegativeTestMultiTenantJSON-634713615-project-member] Enqueued Resource ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f with Priority: HIGHEST for action security_group_members [ 1028.396255] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f with Priority: HIGHEST for action security_group_members [ 1028.396993] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c06941-63aa-4b49-b9e8-da02d464ab8f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.397126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.397126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.397404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.397674] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.397797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.397911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.398123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.398269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.398443] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c06941-63aa-4b49-b9e8-da02d464ab8f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.681868] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8062fa1b-833d-41ea-83be-2da29f1463e8: rpc.has_security_group_logging(os_id): False [ 1028.706712] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.707237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.707349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.707603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.707702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.707993] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.708067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.708145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.708375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.708375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.708514] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.708607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.708665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.708801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.708875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.709073] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.709168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.709230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.709371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.709448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.709533] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1028.787023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.787023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.787023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.787023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.787023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.805020] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1028.822386] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.831389] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-728 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.831389] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-728" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.832154] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-728" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.832154] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-728" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.832290] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.832517] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.832777] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.833101] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.833374] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.833661] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.833804] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1028.833925] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1028.834108] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1028.834335] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1028.834511] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1028.834686] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1028.874169] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1028.874390] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1028.874593] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1028.874754] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-728" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.875230] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-37775bb3-8c05-4800-a905-10164e7dde4e taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.875635] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-37775bb3-8c05-4800-a905-10164e7dde4e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.875635] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-37775bb3-8c05-4800-a905-10164e7dde4e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.875896] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-37775bb3-8c05-4800-a905-10164e7dde4e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.877753] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37775bb3-8c05-4800-a905-10164e7dde4e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.901322] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.901322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.901322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.901702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.901702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.901836] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.902060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.902060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.902124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.902466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.902466] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f already deleted. [ 1028.902466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.325850] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.386203] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.386203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.386203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.386203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.386203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.386203] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 37775bb3-8c05-4800-a905-10164e7dde4e not found, creating... [ 1029.386203] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.386203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.386203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.386203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.386203] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.386591] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.386591] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.386591] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.387178] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.387490] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.387784] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 37775bb3-8c05-4800-a905-10164e7dde4e is going to be created. [ 1029.413604] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.413604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.413604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.413604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.413604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.413604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-37775bb3-8c05-4800-a905-10164e7dde4e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.699931] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1029.700345] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 deletion is rescheduled due to dependency. [ 1029.700345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.701865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.701865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.701865] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.701865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.701865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.701865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.701865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.701865] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.746454] env[65899]: INFO networking_nsxv3.common.synchronization [None req-63052fbf-8100-4672-b323-99dc3f64c9a9 None None] Enqueued Resource ID: 032c3ddc-1780-4a81-af51-042ba312a958 with Priority: HIGHEST for action port [ 1029.747082] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032c3ddc-1780-4a81-af51-042ba312a958 with Priority: HIGHEST for action port [ 1029.747382] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-032c3ddc-1780-4a81-af51-042ba312a958 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.747507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-032c3ddc-1780-4a81-af51-042ba312a958" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.747574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-032c3ddc-1780-4a81-af51-042ba312a958" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.748115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-032c3ddc-1780-4a81-af51-042ba312a958" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.748233] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('032c3ddc-1780-4a81-af51-042ba312a958',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.827788] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.827985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.828075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.828317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.828405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.828505] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1029.868684] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.868958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.869154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.869419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.869642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.884710] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1030.137941] env[65899]: INFO networking_nsxv3.common.synchronization [req-f4463a7b-226d-4bc6-b264-fe62a327f54c req-59ac4045-6a8a-43b0-9ecf-05c4a72be763 service nova] Enqueued Resource ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f with Priority: HIGHEST for action security_group_rules [ 1030.138212] env[65899]: INFO networking_nsxv3.common.synchronization [req-f4463a7b-226d-4bc6-b264-fe62a327f54c req-59ac4045-6a8a-43b0-9ecf-05c4a72be763 service nova] Enqueued Resource ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f with Priority: HIGHEST for action security_group_members [ 1030.138386] env[65899]: INFO networking_nsxv3.common.synchronization [req-f4463a7b-226d-4bc6-b264-fe62a327f54c req-59ac4045-6a8a-43b0-9ecf-05c4a72be763 service nova] Enqueued Resource ID: 37775bb3-8c05-4800-a905-10164e7dde4e with Priority: HIGHEST for action port [ 1030.139895] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f with Priority: HIGHEST for action security_group_rules [ 1030.140438] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f with Priority: HIGHEST for action security_group_members [ 1030.140438] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37775bb3-8c05-4800-a905-10164e7dde4e with Priority: HIGHEST for action port [ 1030.140509] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c06941-63aa-4b49-b9e8-da02d464ab8f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.140627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.140708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.141018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.141111] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c06941-63aa-4b49-b9e8-da02d464ab8f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.145694] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c06941-63aa-4b49-b9e8-da02d464ab8f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.145694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.145694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.145694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.145694] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.145694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.145694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.145694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.145694] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.145694] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c06941-63aa-4b49-b9e8-da02d464ab8f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.147034] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-37775bb3-8c05-4800-a905-10164e7dde4e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.147034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37775bb3-8c05-4800-a905-10164e7dde4e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.147034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37775bb3-8c05-4800-a905-10164e7dde4e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.147034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37775bb3-8c05-4800-a905-10164e7dde4e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.147034] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37775bb3-8c05-4800-a905-10164e7dde4e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.204527] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.204760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.204855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.205395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.205395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.205545] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.205681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.205772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.206018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.206106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.206185] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1030.236631] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.236760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.236810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.237032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.237170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.251293] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1030.253327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 032c3ddc-1780-4a81-af51-042ba312a958 [ 1030.253643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.253784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.253897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.254461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.254461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.254591] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:032c3ddc-1780-4a81-af51-042ba312a958 already deleted. [ 1030.254639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-032c3ddc-1780-4a81-af51-042ba312a958" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.649165] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c06941-63aa-4b49-b9e8-da02d464ab8f taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.649165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.649405] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c06941-63aa-4b49-b9e8-da02d464ab8f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.650704] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37775bb3-8c05-4800-a905-10164e7dde4e with status ACTIVE [ 1030.650704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.650873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.650967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.651232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.651343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.651528] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.651625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.651685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.651840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.651927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.652150] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.652263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.652582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.652582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.652582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.652675] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37775bb3-8c05-4800-a905-10164e7dde4e is going to be updated. [ 1030.678224] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.678224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.678224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.678224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.678224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.678224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37775bb3-8c05-4800-a905-10164e7dde4e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.833158] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1030.833512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.144632] env[65899]: INFO networking_nsxv3.common.synchronization [req-5419f200-c121-4ec7-a34d-e39a7b54632c req-e1e003fb-4d80-4c30-9b4e-1d25b7cd52fc tempest-ServerRescueNegativeTestJSON-46823991 tempest-ServerRescueNegativeTestJSON-46823991-project-member] Enqueued Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_members [ 1031.144632] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_members [ 1031.144919] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a32a98c-e183-4d24-a064-a30e3d8451a7 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.144992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.145406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.145406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.145552] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.145668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.145732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.145916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.146028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.146127] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.154689] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c06941-63aa-4b49-b9e8-da02d464ab8f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.560562] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.560827] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.561025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.561377] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.561760] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.562039] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.562151] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.562389] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.562540] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.562784] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.562898] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.563087] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.563195] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.563315] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.563424] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.564146] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.584413] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.584671] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.584865] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.585224] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-454" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.585718] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-c141b30c-7922-4b7e-b48c-fb05ef4a190c taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.587049] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-c141b30c-7922-4b7e-b48c-fb05ef4a190c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.587287] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-c141b30c-7922-4b7e-b48c-fb05ef4a190c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.587816] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-c141b30c-7922-4b7e-b48c-fb05ef4a190c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.588011] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c141b30c-7922-4b7e-b48c-fb05ef4a190c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.649210] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.649492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.649492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.649719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.649816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.650058] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.650147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.651170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.651170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.651170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.651170] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 already deleted. [ 1031.651170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.657829] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.658096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.658136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.658331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.658435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.658530] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f is going to be created. [ 1031.684683] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.684880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.684977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.685400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.685582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.697993] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f in Status: UNINITIALIZED for 2s [ 1031.899366] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1031.899795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.899960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.900252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.901971] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.902155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.902230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.902457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.902561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.902656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.902754] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.090611] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.091165] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.091165] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.091359] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.091512] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.091717] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port c141b30c-7922-4b7e-b48c-fb05ef4a190c not found, creating... [ 1032.092051] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.092361] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.092475] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.092612] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.092790] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.094651] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.095057] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.095352] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.095704] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.095915] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.096232] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: c141b30c-7922-4b7e-b48c-fb05ef4a190c is going to be created. [ 1032.133207] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.133207] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.133207] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.133207] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.133207] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.133207] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-c141b30c-7922-4b7e-b48c-fb05ef4a190c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268617] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1032.268890] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 deletion is rescheduled due to dependency. [ 1032.269063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.274333] env[65899]: INFO networking_nsxv3.common.synchronization [None req-85c0f77a-22e9-4570-b727-6a2e87f54c78 None None] Enqueued Resource ID: 5847aab2-dad3-4569-b2fe-68b08f15059b with Priority: HIGHEST for action port [ 1032.275461] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5847aab2-dad3-4569-b2fe-68b08f15059b with Priority: HIGHEST for action port [ 1032.276019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5847aab2-dad3-4569-b2fe-68b08f15059b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.276237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5847aab2-dad3-4569-b2fe-68b08f15059b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.276665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5847aab2-dad3-4569-b2fe-68b08f15059b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.277039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5847aab2-dad3-4569-b2fe-68b08f15059b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.277144] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5847aab2-dad3-4569-b2fe-68b08f15059b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.405773] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.405927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.406010] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.406208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.406398] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.406492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.406558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.406699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.406797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.406849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.406994] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.407093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.407147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.407285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.407421] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.407505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.407556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.407684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.407755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.407833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.407920] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.780479] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5847aab2-dad3-4569-b2fe-68b08f15059b [ 1032.780729] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.780883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.781028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.781405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.781405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.781405] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5847aab2-dad3-4569-b2fe-68b08f15059b already deleted. [ 1032.781623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5847aab2-dad3-4569-b2fe-68b08f15059b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.900238] env[65899]: INFO networking_nsxv3.common.synchronization [req-5419f200-c121-4ec7-a34d-e39a7b54632c req-3be9ef38-ecab-4531-b21d-35f8ddf551f1 service nova] Enqueued Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_rules [ 1032.901553] env[65899]: INFO networking_nsxv3.common.synchronization [req-5419f200-c121-4ec7-a34d-e39a7b54632c req-3be9ef38-ecab-4531-b21d-35f8ddf551f1 service nova] Enqueued Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_members [ 1032.901553] env[65899]: INFO networking_nsxv3.common.synchronization [req-5419f200-c121-4ec7-a34d-e39a7b54632c req-3be9ef38-ecab-4531-b21d-35f8ddf551f1 service nova] Enqueued Resource ID: c141b30c-7922-4b7e-b48c-fb05ef4a190c with Priority: HIGHEST for action port [ 1032.903743] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_rules [ 1032.903743] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_members [ 1032.903743] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c141b30c-7922-4b7e-b48c-fb05ef4a190c with Priority: HIGHEST for action port [ 1032.903743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a32a98c-e183-4d24-a064-a30e3d8451a7 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.903743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.903743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.903743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.904163] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.906581] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a32a98c-e183-4d24-a064-a30e3d8451a7 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.906756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.906886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.907286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.907410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.907592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.907592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.908790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.908790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.908790] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.911881] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c141b30c-7922-4b7e-b48c-fb05ef4a190c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.911881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c141b30c-7922-4b7e-b48c-fb05ef4a190c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.911881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c141b30c-7922-4b7e-b48c-fb05ef4a190c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.911881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c141b30c-7922-4b7e-b48c-fb05ef4a190c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.911881] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c141b30c-7922-4b7e-b48c-fb05ef4a190c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.913713] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3990baf0-9e24-4b70-8c31-60cf273fe344: rpc.has_security_group_logging(os_id): False [ 1032.937090] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.937090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.937090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.937090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.937090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.937090] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.937090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.937090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.942021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.942021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.942021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.942021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1033.023974] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.024825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.024825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.024825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.024825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.042890] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1033.414135] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.416069] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a32a98c-e183-4d24-a064-a30e3d8451a7 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.416267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.417440] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c141b30c-7922-4b7e-b48c-fb05ef4a190c with status ACTIVE [ 1033.417560] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.417849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.417945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.418334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.418514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.419267] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.419576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.419726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.420013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.420430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.420527] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.420702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.420836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.421110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.421284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.421478] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c141b30c-7922-4b7e-b48c-fb05ef4a190c is going to be updated. [ 1033.451150] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.451150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.451150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.451150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.451150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.451150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c141b30c-7922-4b7e-b48c-fb05ef4a190c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.687039] env[65899]: INFO networking_nsxv3.common.synchronization [req-1bc85bd1-2b97-4539-a266-03964f316953 req-1a95eb3e-7a31-45d3-9bb7-4679e75a0fee tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1033.687039] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1033.688456] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.688602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.688653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.688917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.689099] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.689630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.689762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.691033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.691033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.691033] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.708389] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f in Status: SUCCESS [ 1033.708651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.708807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.709096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.709263] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.709377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.709439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.709593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.709671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.709753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.709862] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c06941-63aa-4b49-b9e8-da02d464ab8f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.917752] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.190395] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.190594] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.190720] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.190989] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.195019] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.195019] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.195019] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.195019] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.195019] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.195019] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.195019] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.195019] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.195019] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.195019] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.195019] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.195019] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.195019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.195019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.195019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.195783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.195783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.195783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.195783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.195783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.195783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.195975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.195975] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be deleted. [ 1034.212247] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c06941-63aa-4b49-b9e8-da02d464ab8f taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.212616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.212616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.212758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.212993] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.213117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.213185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.213392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.213469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.213561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.213760] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c06941-63aa-4b49-b9e8-da02d464ab8f taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.213903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.213903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.214212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.214212] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.214351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.214351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.214557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.214557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.214684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.214742] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c06941-63aa-4b49-b9e8-da02d464ab8f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.218342] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.218474] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.218666] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.219050] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.219540] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-52b69a81-30d8-4420-993b-7c81ccff166d taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.219871] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-52b69a81-30d8-4420-993b-7c81ccff166d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.220535] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-52b69a81-30d8-4420-993b-7c81ccff166d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.220679] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-52b69a81-30d8-4420-993b-7c81ccff166d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.220911] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52b69a81-30d8-4420-993b-7c81ccff166d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.238698] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.238871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.238909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.239214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.239214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.239746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.420251] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.420440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.420507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.420704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.420812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.420883] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 is going to be created. [ 1034.464436] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.464436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.464918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.464918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.465106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.482979] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 in Status: UNINITIALIZED for 2s [ 1034.718244] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c06941-63aa-4b49-b9e8-da02d464ab8f: rpc.has_security_group_logging(os_id): False [ 1034.724139] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.724311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.724536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.724978] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.725360] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.725583] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 52b69a81-30d8-4420-993b-7c81ccff166d not found, creating... [ 1034.725987] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.726273] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.726405] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.726663] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.726865] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.727210] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.727371] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.727487] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.727799] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.727974] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.728140] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 52b69a81-30d8-4420-993b-7c81ccff166d is going to be created. [ 1034.740445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.740445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.740835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.740835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.740903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.742325] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.742325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.742325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.742325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.742325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.742325] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.742325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.742325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.743350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.743350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.743350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.743350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.743547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.743692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.743761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.743845] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f is going to be created. [ 1034.750459] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.750637] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.750808] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.751156] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.751446] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.751796] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-52b69a81-30d8-4420-993b-7c81ccff166d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.854665] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.854967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.855076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.855410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.855832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.881642] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f in Status: IN_PROGRESS for 2s [ 1035.060824] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1035.061405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.497023] env[65899]: INFO networking_nsxv3.common.synchronization [req-1bc85bd1-2b97-4539-a266-03964f316953 req-6646f41e-43ec-4574-99f5-68536f1300e4 service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 1035.497023] env[65899]: INFO networking_nsxv3.common.synchronization [req-1bc85bd1-2b97-4539-a266-03964f316953 req-6646f41e-43ec-4574-99f5-68536f1300e4 service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1035.497023] env[65899]: INFO networking_nsxv3.common.synchronization [req-1bc85bd1-2b97-4539-a266-03964f316953 req-6646f41e-43ec-4574-99f5-68536f1300e4 service nova] Enqueued Resource ID: 52b69a81-30d8-4420-993b-7c81ccff166d with Priority: HIGHEST for action port [ 1035.497388] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 1035.497483] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1035.497594] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b69a81-30d8-4420-993b-7c81ccff166d with Priority: HIGHEST for action port [ 1035.497875] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.497995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.498591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.498885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.499016] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.500722] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.500722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.500722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.500722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.500722] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.500722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.500722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.500722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.500997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.500997] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.501700] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-52b69a81-30d8-4420-993b-7c81ccff166d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.501793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52b69a81-30d8-4420-993b-7c81ccff166d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.501883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52b69a81-30d8-4420-993b-7c81ccff166d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.502170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52b69a81-30d8-4420-993b-7c81ccff166d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.502828] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52b69a81-30d8-4420-993b-7c81ccff166d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.005819] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.006937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.007506] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.007782] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52b69a81-30d8-4420-993b-7c81ccff166d with status ACTIVE [ 1036.008021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.008091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.008285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.008350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.008435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.008643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.008713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.008772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.008948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.009027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.009211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.009345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.009449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.009518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.009576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.009658] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52b69a81-30d8-4420-993b-7c81ccff166d is going to be updated. [ 1036.036991] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.038211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.038211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.038211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.038211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.038211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52b69a81-30d8-4420-993b-7c81ccff166d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.494888] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 in Status: SUCCESS [ 1036.495333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.495555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.495872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.496178] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.496392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.496581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.496799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.496935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.497123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.497367] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.516084] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.902660] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f in Status: SUCCESS [ 1036.902907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.000264] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.022031] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.022031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.022031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.022031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.022031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.022031] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be created. [ 1037.097275] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.097496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.097961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.098271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.098470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.124820] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: UNINITIALIZED for 2s [ 1037.504015] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a32a98c-e183-4d24-a064-a30e3d8451a7: rpc.has_security_group_logging(os_id): False [ 1037.523692] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.523842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.523909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.524145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.524634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.524634] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.524634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.524805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.524918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.524998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.525097] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 is going to be created. [ 1037.594308] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.594517] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.594600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.594920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.595214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.608553] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 in Status: IN_PROGRESS for 2s [ 1038.254339] env[65899]: INFO networking_nsxv3.common.synchronization [req-fe01e322-4008-4ad0-9aa7-4ad7b3155738 req-c38e5d79-aacf-436d-9acb-07c52d8b8fb5 tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 1038.255940] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 1038.255940] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.255940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.255940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.256551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.256756] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.256922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.257049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.257323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.257323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.257487] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.760034] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.760484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.760484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.760628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.760758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.760991] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.761141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.761225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.761436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.761539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.761716] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 1038.801025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.801275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.801275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.801499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.801646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.811466] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 1039.135898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1039.136113] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.136240] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.136454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.136651] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.136767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.136827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.136988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.137079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.137162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.137253] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.623826] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 in Status: SUCCESS [ 1039.624238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.639958] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.640174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.640174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.640397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.640571] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.640718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.640718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.640950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.640989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.641096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.641245] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.641337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.641415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.641565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.641701] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.641789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.641847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.641981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.642096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.642192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.642282] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.144845] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b339ac-01aa-4f28-9e73-9f48477e571d: rpc.has_security_group_logging(os_id): False [ 1040.166657] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.166967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.167296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.167607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.167726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.168025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.168152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.168192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.168400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.168500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.168893] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.168987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.169104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.169215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.169282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.169495] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.169591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.169648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.169788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.169859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.169941] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be created. [ 1040.248232] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.248474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.248474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.248673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.248932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.266031] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1040.824167] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 1040.824300] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 deletion is rescheduled due to dependency. [ 1040.824435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.280058] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1042.280365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.256251] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1043.258312] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1044.280191] env[65899]: INFO networking_nsxv3.common.synchronization [None req-1eff8d91-1a9b-4120-908f-ce4fee12f6d1 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1044.280739] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1044.281058] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.281233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.281233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.281439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.281599] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.281691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.281743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.281883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.281965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.282248] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.784778] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.289182] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.436197] env[65899]: INFO networking_nsxv3.common.synchronization [req-9603906e-323e-4ec6-b43a-ffe181b32b53 req-526f2ae7-4de4-4d26-98b4-768d9f0c6aac tempest-AttachInterfacesV270Test-1679269749 tempest-AttachInterfacesV270Test-1679269749-project-member] Enqueued Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGHEST for action security_group_members [ 1045.436843] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGHEST for action security_group_members [ 1045.437488] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c7c205-f0b9-4a7b-b88d-839171878ae3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.438205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.438205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.438205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.438205] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.438205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.438714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.438714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.438714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.438714] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.793025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.793025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.793025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.793025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.793025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.793025] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 1045.794708] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.794908] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-12" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.795043] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-12" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.795374] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-12" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.795658] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.795822] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.795940] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.796253] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.796404] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.796619] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.796731] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.796844] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.797177] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.797177] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.797177] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.797364] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.818937] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.819128] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1045.822037] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.822037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-12" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.822037] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-bb1ea885-d001-4551-a3a8-9d691ca1abea taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.822037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-bb1ea885-d001-4551-a3a8-9d691ca1abea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.822037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-bb1ea885-d001-4551-a3a8-9d691ca1abea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.822037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-bb1ea885-d001-4551-a3a8-9d691ca1abea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.822037] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb1ea885-d001-4551-a3a8-9d691ca1abea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.832055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.832400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.832493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.832727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.832846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.843299] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1045.940917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.941347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.941347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.941787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.941787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.942116] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.942116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.942116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.942764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.942764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.942764] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 already deleted. [ 1045.942764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.324286] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.324765] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.325018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.325414] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.325592] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.325775] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port bb1ea885-d001-4551-a3a8-9d691ca1abea not found, creating... [ 1046.326208] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.326479] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.326685] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.326982] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.327150] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.327467] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.327636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.327750] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.327976] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.328142] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.328282] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: bb1ea885-d001-4551-a3a8-9d691ca1abea is going to be created. [ 1046.350377] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.350536] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.350656] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.351162] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.351366] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.351662] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-bb1ea885-d001-4551-a3a8-9d691ca1abea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.167273] env[65899]: INFO networking_nsxv3.common.synchronization [req-9603906e-323e-4ec6-b43a-ffe181b32b53 req-38c445a1-0637-4f6d-8e1a-17bede5940df service nova] Enqueued Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGHEST for action security_group_rules [ 1047.167569] env[65899]: INFO networking_nsxv3.common.synchronization [req-9603906e-323e-4ec6-b43a-ffe181b32b53 req-38c445a1-0637-4f6d-8e1a-17bede5940df service nova] Enqueued Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGHEST for action security_group_members [ 1047.167751] env[65899]: INFO networking_nsxv3.common.synchronization [req-9603906e-323e-4ec6-b43a-ffe181b32b53 req-38c445a1-0637-4f6d-8e1a-17bede5940df service nova] Enqueued Resource ID: bb1ea885-d001-4551-a3a8-9d691ca1abea with Priority: HIGHEST for action port [ 1047.168797] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGHEST for action security_group_rules [ 1047.169064] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGHEST for action security_group_members [ 1047.169153] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1ea885-d001-4551-a3a8-9d691ca1abea with Priority: HIGHEST for action port [ 1047.169777] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.169954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.170065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.170916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.171081] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.172337] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c7c205-f0b9-4a7b-b88d-839171878ae3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.172478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.172536] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.172878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.173105] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.173217] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.173306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.173776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.173776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.173776] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.175369] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb1ea885-d001-4551-a3a8-9d691ca1abea taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.175369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb1ea885-d001-4551-a3a8-9d691ca1abea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.175369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb1ea885-d001-4551-a3a8-9d691ca1abea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.176393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb1ea885-d001-4551-a3a8-9d691ca1abea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.176520] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb1ea885-d001-4551-a3a8-9d691ca1abea',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.679545] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb1ea885-d001-4551-a3a8-9d691ca1abea with status ACTIVE [ 1047.682732] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.682732] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.682732] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.682732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.682732] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb1ea885-d001-4551-a3a8-9d691ca1abea is going to be updated. [ 1047.683831] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c7c205-f0b9-4a7b-b88d-839171878ae3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.684485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.684485] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.715754] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.715922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.715966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.716205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.716349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.716547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb1ea885-d001-4551-a3a8-9d691ca1abea" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.852200] env[65899]: INFO networking_nsxv3.common.synchronization [req-9ec9cf5c-d91e-4f18-aebf-f97ba00ad45b req-819c2d7b-ae17-4795-89fd-0a8b379a16b5 tempest-ServersAdminTestJSON-2084545516 tempest-ServersAdminTestJSON-2084545516-project-member] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1047.853042] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1047.853424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.854450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.854450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.854450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.854450] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.854450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.854895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.854895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.854895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.854895] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.858696] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1047.858696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.188652] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.295247] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.295563] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.295759] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.296117] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.296532] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.296767] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.296892] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.297142] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.297286] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.297501] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.297605] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.297732] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.297887] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.297978] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.298097] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.298224] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.318855] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.318855] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.319026] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.319178] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-215" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.319478] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.319626] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.319761] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.320194] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.320236] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a725ae2b-7cda-4aef-a76c-d7b6acee24f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.358421] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.692245] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.692679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.692679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.692829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.692829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.693046] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 is going to be created. [ 1048.725484] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.725790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.725790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.725971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.726194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.737351] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 in Status: UNINITIALIZED for 2s [ 1048.822808] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.823188] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.823483] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.823861] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.824072] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.824165] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port a725ae2b-7cda-4aef-a76c-d7b6acee24f5 not found, creating... [ 1048.824497] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.824670] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.824803] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.825063] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.825212] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.825616] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.825832] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.825975] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.826291] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.826526] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.826715] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: a725ae2b-7cda-4aef-a76c-d7b6acee24f5 is going to be created. [ 1048.860067] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.860067] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.860825] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.860825] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.860825] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.861350] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.862414] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.030547] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.030772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.030898] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.031280] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.031585] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.031731] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.031895] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.032261] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.032446] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.032731] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.032915] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.033145] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.033316] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.033461] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.033599] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.034695] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.068114] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.068178] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.068326] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.068551] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.068912] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-1a78d031-b49c-450e-834a-e167e0fa6d5f taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.069131] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-1a78d031-b49c-450e-834a-e167e0fa6d5f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.069300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-1a78d031-b49c-450e-834a-e167e0fa6d5f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.069704] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-1a78d031-b49c-450e-834a-e167e0fa6d5f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.069894] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a78d031-b49c-450e-834a-e167e0fa6d5f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.365414] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.365414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.365414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.365692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.365692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.365750] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1049.408528] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.408750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.408750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.408963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.409120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.422530] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1049.563945] env[65899]: INFO networking_nsxv3.common.synchronization [req-9ec9cf5c-d91e-4f18-aebf-f97ba00ad45b req-3642bc34-1baf-4051-97f1-0189f0dbcb3a service nova] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_rules [ 1049.564263] env[65899]: INFO networking_nsxv3.common.synchronization [req-9ec9cf5c-d91e-4f18-aebf-f97ba00ad45b req-3642bc34-1baf-4051-97f1-0189f0dbcb3a service nova] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1049.564486] env[65899]: INFO networking_nsxv3.common.synchronization [req-9ec9cf5c-d91e-4f18-aebf-f97ba00ad45b req-3642bc34-1baf-4051-97f1-0189f0dbcb3a service nova] Enqueued Resource ID: a725ae2b-7cda-4aef-a76c-d7b6acee24f5 with Priority: HIGHEST for action port [ 1049.565734] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_rules [ 1049.565931] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1049.566090] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a725ae2b-7cda-4aef-a76c-d7b6acee24f5 with Priority: HIGHEST for action port [ 1049.566495] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.566618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.566686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.567046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.567140] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.568630] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.568762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.569222] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.572626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.572691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.574592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.574592] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a725ae2b-7cda-4aef-a76c-d7b6acee24f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.577140] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.577475] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.577654] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.578137] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.578273] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.578619] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 1a78d031-b49c-450e-834a-e167e0fa6d5f not found, creating... [ 1049.579929] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.579929] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.580388] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.581078] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.581799] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.581799] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.581799] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.581975] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.582847] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.583126] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.583207] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 1a78d031-b49c-450e-834a-e167e0fa6d5f is going to be created. [ 1049.612992] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.612992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.612992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.612992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.612992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.613362] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-1a78d031-b49c-450e-834a-e167e0fa6d5f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.075913] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.076513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.085024] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a725ae2b-7cda-4aef-a76c-d7b6acee24f5 with status ACTIVE [ 1050.085626] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.085626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.085626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.085931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.085931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.086198] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.086198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.086307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.086449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.086559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.086764] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.086859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.087201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.087201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.087201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.087201] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a725ae2b-7cda-4aef-a76c-d7b6acee24f5 is going to be updated. [ 1050.112067] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.112067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.112067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.112067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.112067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.112067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a725ae2b-7cda-4aef-a76c-d7b6acee24f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.312907] env[65899]: INFO networking_nsxv3.common.synchronization [req-5aa2a250-04fc-4719-bdec-dca895acc0a2 req-2283b44a-d6f6-44d2-b34a-e0fd8acfbe5d service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 1050.314018] env[65899]: INFO networking_nsxv3.common.synchronization [req-5aa2a250-04fc-4719-bdec-dca895acc0a2 req-2283b44a-d6f6-44d2-b34a-e0fd8acfbe5d service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1050.314018] env[65899]: INFO networking_nsxv3.common.synchronization [req-5aa2a250-04fc-4719-bdec-dca895acc0a2 req-2283b44a-d6f6-44d2-b34a-e0fd8acfbe5d service nova] Enqueued Resource ID: 1a78d031-b49c-450e-834a-e167e0fa6d5f with Priority: HIGHEST for action port [ 1050.314018] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 1050.314277] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1050.314277] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a78d031-b49c-450e-834a-e167e0fa6d5f with Priority: HIGHEST for action port [ 1050.315305] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.315518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.315582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.315784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.315865] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.317822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.317945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.318037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.318232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.318387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.318489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.318546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.319575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.319575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.319575] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.320912] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a78d031-b49c-450e-834a-e167e0fa6d5f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.320912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a78d031-b49c-450e-834a-e167e0fa6d5f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.320912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a78d031-b49c-450e-834a-e167e0fa6d5f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.321178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a78d031-b49c-450e-834a-e167e0fa6d5f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.321178] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a78d031-b49c-450e-834a-e167e0fa6d5f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.748306] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 in Status: SUCCESS [ 1050.748417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.748613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.748893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.749128] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.749606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.749606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.749606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.749606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.750100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.750255] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.824296] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.824500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.824991] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.825798] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a78d031-b49c-450e-834a-e167e0fa6d5f with status ACTIVE [ 1050.826097] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.826301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.826388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.826651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.826854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.826973] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.827299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.828142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.828309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.828397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.828614] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.828919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.828919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.828919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.829024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.829054] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a78d031-b49c-450e-834a-e167e0fa6d5f is going to be updated. [ 1050.869758] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.869993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.870555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.870555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.870555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.870746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a78d031-b49c-450e-834a-e167e0fa6d5f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.253878] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c7c205-f0b9-4a7b-b88d-839171878ae3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.254223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.254223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.254328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.254483] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.254596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.254639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.254781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.254863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.254947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.255124] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c7c205-f0b9-4a7b-b88d-839171878ae3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.255222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.255327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.255477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.255685] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.255835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.255927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.256143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.256281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.256401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.256552] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.332274] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.435136] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1051.435136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.435339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.435496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.435706] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.435814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.435886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.436036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.436118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.436204] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.758946] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9c7c205-f0b9-4a7b-b88d-839171878ae3: rpc.has_security_group_logging(os_id): False [ 1051.779760] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.779760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.779760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.779760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.779760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.779990] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.779990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.780070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.780175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.780250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.780442] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.780537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.780595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.780731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.780801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.780979] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.781101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.781162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.781297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.781370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.781450] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 is going to be created. [ 1051.834504] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.834708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.834763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.834998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.835118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.835230] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 1051.848769] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.848769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.848769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.848769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.849099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.867105] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 in Status: IN_PROGRESS for 2s [ 1051.894698] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.894698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.894698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.894698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.894698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.909830] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1051.958536] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.412627] env[65899]: INFO networking_nsxv3.common.synchronization [req-584e52d5-449c-4c32-8061-5bb152688354 req-00beab69-edb2-4671-af45-b2dd9e493645 tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 1052.413728] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 1052.413728] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.413728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.413728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.413932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.414166] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.414316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.414378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.414623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.414716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.414998] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.446038] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.734528] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-918 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.734789] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.734886] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.735889] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.735889] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.735889] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.735889] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.736183] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.736219] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.736398] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.736537] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.736612] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.736868] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.737016] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.737126] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.737255] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.758972] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.759164] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.759305] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.759718] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.760906] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-416c1a0d-1d49-45c5-9c4d-7795e4adc489 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.760906] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-416c1a0d-1d49-45c5-9c4d-7795e4adc489" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.760906] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-416c1a0d-1d49-45c5-9c4d-7795e4adc489" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.761258] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-416c1a0d-1d49-45c5-9c4d-7795e4adc489" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.761258] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('416c1a0d-1d49-45c5-9c4d-7795e4adc489',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.917227] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.917587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.917587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.917715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.917765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.917961] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.918097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.918163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.918318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.918435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.918470] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 1052.948288] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.948454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.948500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.948771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.948844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.950026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.950377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.950377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.950377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.950510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.950510] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1052.961643] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 1052.983573] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.983573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.983573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.983759] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.984520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.994274] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1053.264624] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.265160] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.265351] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.265680] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.265869] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.266051] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 416c1a0d-1d49-45c5-9c4d-7795e4adc489 not found, creating... [ 1053.266385] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.266584] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.266722] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.267570] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.267734] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.268112] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.268283] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.268436] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.268763] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.268898] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.269053] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 416c1a0d-1d49-45c5-9c4d-7795e4adc489 is going to be created. [ 1053.297879] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.298192] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.298246] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.298529] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.298762] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.298986] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-416c1a0d-1d49-45c5-9c4d-7795e4adc489" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.885214] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 in Status: SUCCESS [ 1053.885214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.918496] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1053.918716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.918891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.919143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.919347] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.919467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.919539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.919684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.919763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.919849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.919968] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.018526] env[65899]: INFO networking_nsxv3.common.synchronization [req-584e52d5-449c-4c32-8061-5bb152688354 req-9b64106f-5c93-4320-8869-50e8f62b6e77 service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 1054.018785] env[65899]: INFO networking_nsxv3.common.synchronization [req-584e52d5-449c-4c32-8061-5bb152688354 req-9b64106f-5c93-4320-8869-50e8f62b6e77 service nova] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 1054.019127] env[65899]: INFO networking_nsxv3.common.synchronization [req-584e52d5-449c-4c32-8061-5bb152688354 req-9b64106f-5c93-4320-8869-50e8f62b6e77 service nova] Enqueued Resource ID: 416c1a0d-1d49-45c5-9c4d-7795e4adc489 with Priority: HIGHEST for action port [ 1054.019523] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_rules [ 1054.019677] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 1054.019767] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416c1a0d-1d49-45c5-9c4d-7795e4adc489 with Priority: HIGHEST for action port [ 1054.020531] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.020660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.020733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.020944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.021038] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.021927] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.022039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.022245] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-416c1a0d-1d49-45c5-9c4d-7795e4adc489 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.022362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-416c1a0d-1d49-45c5-9c4d-7795e4adc489" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.022758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-416c1a0d-1d49-45c5-9c4d-7795e4adc489" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.022758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-416c1a0d-1d49-45c5-9c4d-7795e4adc489" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.022758] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('416c1a0d-1d49-45c5-9c4d-7795e4adc489',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.422646] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.422877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.422989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.423377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.423638] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.423756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.423825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.423997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.424103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.424191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.424362] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.424470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.424530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.424876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.424876] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.424997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.424997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.425100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.425174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.425254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.425340] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.525082] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.525319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.525516] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 416c1a0d-1d49-45c5-9c4d-7795e4adc489 with status ACTIVE [ 1054.525749] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.525863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.525962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.526213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.526306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.526563] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.526726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.526794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.526956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.527105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.527295] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.527438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.527497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.527647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.527801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.527877] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 416c1a0d-1d49-45c5-9c4d-7795e4adc489 is going to be updated. [ 1054.568807] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.569026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.569026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.569235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.569402] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.569572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-416c1a0d-1d49-45c5-9c4d-7795e4adc489" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.927410] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b339ac-01aa-4f28-9e73-9f48477e571d: rpc.has_security_group_logging(os_id): False [ 1054.946218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.946427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.946427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.946587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.946673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.946864] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.946966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.947041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.947207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.947284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.947471] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.947565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.947626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.947766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.947837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.948109] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.948249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.948311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.948455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.948531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.948617] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 1054.970155] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 1054.970393] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 deletion is rescheduled due to dependency. [ 1054.970897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.971186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.971556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.971815] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.972128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.972224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.972516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.972516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.972619] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.003179] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1055.003375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.003628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.003845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.004054] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.004209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.004272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.004870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.005014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.005121] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.005216] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.009675] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.009675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.009865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.009951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.010174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.025809] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1055.474889] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.508132] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.508264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.508264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.508503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.509054] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.509054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.509054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.509054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.509054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.509286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.509286] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.509426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.509426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.510015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.510015] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.510015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.510015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.510638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.510638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.510638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.510638] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.978554] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.015652] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8062fa1b-833d-41ea-83be-2da29f1463e8: rpc.has_security_group_logging(os_id): False [ 1056.041025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.041025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.041025] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.041025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.041976] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.042201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.042340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.042904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.043190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.043444] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1056.119430] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.119887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.119887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.119887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.120073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.137408] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1056.482498] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.482498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.482498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.482734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.483271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.483271] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 1056.522211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.522211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.522211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.522581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.522581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.533940] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 1057.051612] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1057.051612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.661271] env[65899]: INFO networking_nsxv3.common.synchronization [req-9719cd47-2b2a-4f46-be22-b2472b0c36e1 req-6a199658-7cca-4a2c-925c-1ec0042d735a tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1057.661271] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1057.661271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.661504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.661733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.662139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.662461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.662699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.662893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.663239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.663647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.664084] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.162314] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1058.162607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.168670] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.168670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.168670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.168670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.169612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.169903] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.171260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.171260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.171260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.171260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.171260] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1058.202682] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.202940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.202940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.203406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.203406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.216698] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1058.291920] env[65899]: INFO networking_nsxv3.common.synchronization [req-9719cd47-2b2a-4f46-be22-b2472b0c36e1 req-7092dfdf-1fc5-4701-b149-57e7400bdee2 tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1058.292684] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1058.292983] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.295186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.548820] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 1058.554158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.554158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.554158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.554158] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.554158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.554158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.554158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.554158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.554158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.554158] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.697762] env[65899]: INFO networking_nsxv3.common.synchronization [req-d12985fe-c893-44bd-a8ec-8050074f0211 req-328bc218-5212-4666-8afc-00672a115407 tempest-ServersNegativeTestMultiTenantJSON-634713615 tempest-ServersNegativeTestMultiTenantJSON-634713615-project-member] Enqueued Resource ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f with Priority: HIGHEST for action security_group_members [ 1058.698408] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f with Priority: HIGHEST for action security_group_members [ 1058.698979] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c06941-63aa-4b49-b9e8-da02d464ab8f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.698979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.700571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.700571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.700571] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.700571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.700571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.700571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.700571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.700571] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c06941-63aa-4b49-b9e8-da02d464ab8f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.848863] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-515 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.849090] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-515" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.849190] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-515" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.849600] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-515" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.849779] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.849950] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.850660] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.850926] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.851130] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.851417] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.851565] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.851752] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.851889] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.852024] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.852122] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.852257] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.880487] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.880662] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1058.880871] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.880956] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-515" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.881293] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.881454] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.881595] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.881904] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.883485] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c11e8b7a-3a63-4940-be08-488f0e7c7dbe',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.058387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.058563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.058614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.060258] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.060258] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.060258] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.060258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.060800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.060800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.060800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.060800] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.203023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.203023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.203023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.203023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.203023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.203473] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.203473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.203473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.203589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.203634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.203714] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f is going to be updated. [ 1059.242126] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.242250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.242250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.242431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.242563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.253222] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f in Status: IN_PROGRESS for 2s [ 1059.385123] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.385468] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.385733] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.386170] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.386398] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.386654] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port c11e8b7a-3a63-4940-be08-488f0e7c7dbe not found, creating... [ 1059.387110] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.387358] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.387533] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.387860] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.388087] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.388542] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.388781] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.388973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.389285] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.389489] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.389696] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: c11e8b7a-3a63-4940-be08-488f0e7c7dbe is going to be created. [ 1059.411018] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.411332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.411527] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.411907] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.412248] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.412567] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.562980] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc14a464-84a2-4f30-88ae-7b0da98e4e95: rpc.has_security_group_logging(os_id): False [ 1059.584403] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.584403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.584403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.584403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.584683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.584683] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.584791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.584861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.585071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.585190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.585572] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.585893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.586122] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.586457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.586626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.587045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.587191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.587280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.587527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.587679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.587865] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 1059.679922] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.679922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.679922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.679922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.679922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.705226] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 1060.180713] env[65899]: INFO networking_nsxv3.common.synchronization [req-9719cd47-2b2a-4f46-be22-b2472b0c36e1 req-c8b97b81-a5f5-46d5-ba52-4e39cd26a664 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1060.181054] env[65899]: INFO networking_nsxv3.common.synchronization [req-9719cd47-2b2a-4f46-be22-b2472b0c36e1 req-c8b97b81-a5f5-46d5-ba52-4e39cd26a664 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1060.181127] env[65899]: INFO networking_nsxv3.common.synchronization [req-9719cd47-2b2a-4f46-be22-b2472b0c36e1 req-c8b97b81-a5f5-46d5-ba52-4e39cd26a664 service nova] Enqueued Resource ID: c11e8b7a-3a63-4940-be08-488f0e7c7dbe with Priority: HIGHEST for action port [ 1060.182978] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1060.182978] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1060.182978] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c11e8b7a-3a63-4940-be08-488f0e7c7dbe with Priority: HIGHEST for action port [ 1060.182978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.182978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.182978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.182978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.182978] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.184524] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.184524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.184524] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.184524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.184524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.184857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.184857] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c11e8b7a-3a63-4940-be08-488f0e7c7dbe',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.229114] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1060.229503] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 deletion is rescheduled due to dependency. [ 1060.229503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.229503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.229712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.229899] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.230019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.230074] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.230240] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.230735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.230735] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.686595] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.686767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.687029] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c11e8b7a-3a63-4940-be08-488f0e7c7dbe with status ACTIVE [ 1060.687198] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.687366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.687530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.687806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.687985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.688440] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.688440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.688640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.688759] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.689127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.689238] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.689343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.689730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.689730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.689730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.689890] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c11e8b7a-3a63-4940-be08-488f0e7c7dbe is going to be updated. [ 1060.720308] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.721073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.721073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.723381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.723381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.723558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c11e8b7a-3a63-4940-be08-488f0e7c7dbe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.733276] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.237138] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.270225] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f in Status: SUCCESS [ 1061.271470] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c06941-63aa-4b49-b9e8-da02d464ab8f deletion is rescheduled due to dependency. [ 1061.271470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c06941-63aa-4b49-b9e8-da02d464ab8f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.336571] env[65899]: INFO networking_nsxv3.common.synchronization [req-e09ee133-8a1f-4c8b-8def-62b9446c030c req-a7da8151-b4d4-4af9-be3e-8759ced9d42a tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1061.337383] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1061.337832] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.338036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.338169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.338461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.339068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.339068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.339068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.339290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.339290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.339381] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.573088] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.573347] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-678" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.573494] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-678" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.574070] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-678" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.574158] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.574323] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.574484] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.574738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.574989] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.575234] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.575378] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.575590] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.575673] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.576091] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.576091] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.576091] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.599892] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.600239] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1061.600396] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.600633] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-678" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.601136] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.601383] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.601448] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.601810] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.601937] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.728075] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 1061.728341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.742638] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.742877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.742877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.743208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.743372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.743536] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1061.787404] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.787404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.787404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.787404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.787404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.798037] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1061.843151] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.843151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.843151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.843151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.843387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.843740] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.843946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.844062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.844303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.844433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.844564] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1061.880146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.880315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.880386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.880604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.880782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.891440] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1062.105684] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.105684] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.105684] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.105684] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.105684] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.107272] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3 not found, creating... [ 1062.107272] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.107272] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.107272] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.107272] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.107272] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.107272] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.107272] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.107765] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.107765] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.107765] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.107904] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3 is going to be created. [ 1062.136102] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.136496] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.136768] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.137227] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.137628] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.138076] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.209106] env[65899]: INFO networking_nsxv3.common.synchronization [req-d0811757-5431-4c31-a013-e238a7428793 req-e1a8f1c2-95a3-4a98-96cc-eb3bbc32343a tempest-ImagesOneServerTestJSON-1733106166 tempest-ImagesOneServerTestJSON-1733106166-project-member] Enqueued Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGHEST for action security_group_members [ 1062.209860] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGHEST for action security_group_members [ 1062.211190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ada686fd-cb59-44cf-975b-4402d84546e6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.211378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.211451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.211668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.211854] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.212010] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.212110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.212287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.212376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.212471] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.715781] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.715781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.719743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.719743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.719743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.719743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.719743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.719743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.719743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.719743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.719743] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada686fd-cb59-44cf-975b-4402d84546e6 is going to be updated. [ 1062.755378] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.755378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.755378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.755378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.755378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.771427] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada686fd-cb59-44cf-975b-4402d84546e6 in Status: IN_PROGRESS for 2s [ 1062.932592] env[65899]: INFO networking_nsxv3.common.synchronization [req-9719cd47-2b2a-4f46-be22-b2472b0c36e1 req-c853ab98-2539-4c49-bf60-a4c5b0193600 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1062.932875] env[65899]: INFO networking_nsxv3.common.synchronization [req-9719cd47-2b2a-4f46-be22-b2472b0c36e1 req-c853ab98-2539-4c49-bf60-a4c5b0193600 service nova] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1062.932954] env[65899]: INFO networking_nsxv3.common.synchronization [req-9719cd47-2b2a-4f46-be22-b2472b0c36e1 req-c853ab98-2539-4c49-bf60-a4c5b0193600 service nova] Enqueued Resource ID: 06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3 with Priority: HIGHEST for action port [ 1062.933563] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_rules [ 1062.933707] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1062.933816] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3 with Priority: HIGHEST for action port [ 1062.934055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.934254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.934399] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.934460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.934671] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.934758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.934794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.935091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.935091] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.438301] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3 with status ACTIVE [ 1063.438580] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.439134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.439134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.439134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.439134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.439534] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.439534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.439534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.439645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.439645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.441649] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.441649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.441649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.441649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.441649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.441649] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3 is going to be updated. [ 1063.466132] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.466426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.466546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.467339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.467339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.467339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06f9d5f3-dbc8-4b81-a316-c4a27d31f2a3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.810465] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1063.810796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.810855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.811190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.811401] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.811524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.811623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.811753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.813527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.813527] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.903658] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1063.903858] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1063.903974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.317444] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.785067] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ada686fd-cb59-44cf-975b-4402d84546e6 in Status: SUCCESS [ 1064.785260] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ada686fd-cb59-44cf-975b-4402d84546e6 deletion is rescheduled due to dependency. [ 1064.785365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.821121] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.267972] env[65899]: INFO networking_nsxv3.common.synchronization [req-be0b09a7-6194-488b-9d2e-f5baa08859ea req-ccfd9631-36c4-4cf4-8cdb-8fbdf8351a55 tempest-ServerGroupTestJSON-567335715 tempest-ServerGroupTestJSON-567335715-project-member] Enqueued Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGHEST for action security_group_members [ 1065.268528] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGHEST for action security_group_members [ 1065.268827] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.268952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.269419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.269780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.270767] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.270990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.271207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.271431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.271564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.271867] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.325950] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.326341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.327384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.327509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.327934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.328633] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1065.367723] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.367723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.367723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.367723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.367723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.394097] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1065.774687] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.774910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.775307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.775655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.775764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.776172] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.776172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.776297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.776397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.776477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.776585] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 already deleted. [ 1065.776687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.779343] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-43 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.779529] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-43" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.779650] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-43" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.780227] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-43" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.780227] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.780366] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.780494] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.780721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.780897] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.781220] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.781411] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.781557] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.781726] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.781851] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.781957] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.782101] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.803128] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.803704] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.803704] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.804011] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-43" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.804541] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-8c6f2a75-186c-48fa-9fed-8920528f02cd taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.805377] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-8c6f2a75-186c-48fa-9fed-8920528f02cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.805710] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-8c6f2a75-186c-48fa-9fed-8920528f02cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.806223] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-8c6f2a75-186c-48fa-9fed-8920528f02cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.806491] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c6f2a75-186c-48fa-9fed-8920528f02cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.042578] env[65899]: INFO networking_nsxv3.common.synchronization [req-7ad4da5b-db42-4c7c-af38-662acb42f51f req-248cd82c-1cc2-4067-80ee-5f27430ee509 tempest-AttachInterfacesV270Test-1679269749 tempest-AttachInterfacesV270Test-1679269749-project-member] Enqueued Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGHEST for action security_group_members [ 1066.043111] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGHEST for action security_group_members [ 1066.043791] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c7c205-f0b9-4a7b-b88d-839171878ae3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.043927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.043927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.045055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.045877] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.046086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.046167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.046345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.046433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.046544] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.310832] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.311182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.311334] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.311620] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.311771] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.313442] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 8c6f2a75-186c-48fa-9fed-8920528f02cd not found, creating... [ 1066.313442] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.313442] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.313442] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.313442] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.313442] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.314741] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.314741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.314741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.314741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.314741] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.314741] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 8c6f2a75-186c-48fa-9fed-8920528f02cd is going to be created. [ 1066.339218] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.339501] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.339667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.340106] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.340408] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.340927] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-8c6f2a75-186c-48fa-9fed-8920528f02cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.548777] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.548967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.551706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.551706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.551706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.551706] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.551706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.551706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.551706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.551706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.551706] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 is going to be updated. [ 1066.592309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.592309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.592309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.592309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.592309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.600534] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 in Status: IN_PROGRESS for 2s [ 1067.164565] env[65899]: INFO networking_nsxv3.common.synchronization [req-be0b09a7-6194-488b-9d2e-f5baa08859ea req-373a73a0-9b7e-4e40-91a7-2573518e7e91 service nova] Enqueued Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGHEST for action security_group_rules [ 1067.164565] env[65899]: INFO networking_nsxv3.common.synchronization [req-be0b09a7-6194-488b-9d2e-f5baa08859ea req-373a73a0-9b7e-4e40-91a7-2573518e7e91 service nova] Enqueued Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGHEST for action security_group_members [ 1067.164565] env[65899]: INFO networking_nsxv3.common.synchronization [req-be0b09a7-6194-488b-9d2e-f5baa08859ea req-373a73a0-9b7e-4e40-91a7-2573518e7e91 service nova] Enqueued Resource ID: 8c6f2a75-186c-48fa-9fed-8920528f02cd with Priority: HIGHEST for action port [ 1067.165378] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGHEST for action security_group_rules [ 1067.165652] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGHEST for action security_group_members [ 1067.166266] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c6f2a75-186c-48fa-9fed-8920528f02cd with Priority: HIGHEST for action port [ 1067.166266] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.166501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.166501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.166853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.167128] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.170721] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.170947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.171378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.171378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.171522] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.171587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.171774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.173174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.173174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.173174] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.174994] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c6f2a75-186c-48fa-9fed-8920528f02cd taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.174994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c6f2a75-186c-48fa-9fed-8920528f02cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.174994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c6f2a75-186c-48fa-9fed-8920528f02cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.174994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c6f2a75-186c-48fa-9fed-8920528f02cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.174994] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c6f2a75-186c-48fa-9fed-8920528f02cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.407477] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1067.407936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.408242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.408538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.408819] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.408994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.409106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.409334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.409460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.409765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.409765] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.411462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.411462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.411462] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.411462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.411632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.411784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.411862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.412067] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.675020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.675020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.675020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.679448] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c6f2a75-186c-48fa-9fed-8920528f02cd with status ACTIVE [ 1067.680603] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.680855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.680928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.681173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.681267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.681474] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.681624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.681707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.681888] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.681982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.682190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.682280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.682341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.682479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.682552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.682662] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c6f2a75-186c-48fa-9fed-8920528f02cd is going to be updated. [ 1067.706383] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.706539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.706678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.706829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.706964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.707139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c6f2a75-186c-48fa-9fed-8920528f02cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.916037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.916037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.916037] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.179847] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.419054] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.615047] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 in Status: SUCCESS [ 1068.615377] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 deletion is rescheduled due to dependency. [ 1068.615996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.690812] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.691175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.691342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.691704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.692863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.693049] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 is going to be created. [ 1068.724775] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.724775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.724775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.725400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.725797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.740613] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 in Status: UNINITIALIZED for 2s [ 1068.922875] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.923210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.923210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.923505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.923505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.923505] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1068.958567] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.958725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.958725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.958881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.959043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.971828] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1069.734229] env[65899]: INFO networking_nsxv3.common.synchronization [req-58869838-98e6-4309-a65f-96fc31a31b6c req-c20b6c6a-6037-423d-8c65-1f96a22f6b05 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1069.734834] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1069.735169] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.735316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.735379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.735582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.735796] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.735882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.735918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.737184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.737184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.737184] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.238772] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.742096] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.762860] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 in Status: SUCCESS [ 1070.762860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.764589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.766795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.766795] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.766920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.767464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.767464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.767464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.767619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.767653] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.987924] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1070.988779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.989075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.989384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.989698] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.989943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.989943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.990297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.990297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.990471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.990681] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.990859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.991070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.991222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.994107] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.994107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.994107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.994107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.994107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.994107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.994107] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.035049] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c606f8fc-568a-4bc2-ab0e-8da48a5fbcbd tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1071.036189] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1071.036767] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.036911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.247530] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.247755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.247911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.248185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.248322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.248482] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 1071.274224] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.274563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.274563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.276170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.276170] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.276170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.276170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.276170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.276170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.276170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.276170] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.276170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.276170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.276704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.276704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.276704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.276704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.276941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.276941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.277990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.277990] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.313411] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.313411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.313411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.313411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.313411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.325576] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1071.495370] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2db7096a-5721-4998-9040-4834cd315121: rpc.has_security_group_logging(os_id): False [ 1071.523077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.523415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.523415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.523646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.523716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.523880] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.523989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.524056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.524250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.524327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.524583] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.524746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.524861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.525184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.525299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.525628] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.525787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.525887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.525981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.526085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.526198] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1071.611815] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.611999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.612143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.612368] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.612562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.630802] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1071.782022] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef83d33e-bb76-4bd8-9c91-f6567ebf6c19: rpc.has_security_group_logging(os_id): False [ 1071.817612] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.817805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.818242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.818242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.818362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.818514] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.818662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.818770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.818902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.818995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.819250] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.819422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.819462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.819595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.819824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.819980] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.820255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.820376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.820630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.820701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.821025] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 is going to be created. [ 1071.934946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.935231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.935231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.935422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.935554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.965913] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 in Status: IN_PROGRESS for 2s [ 1072.500132] env[65899]: INFO networking_nsxv3.common.synchronization [None req-4a646ddf-6bac-4c3a-8ca7-bc237118a8ce None None] Enqueued Resource ID: 27dd4e24-29b4-45a8-8d29-0eb29d698074 with Priority: HIGHEST for action port [ 1072.501824] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27dd4e24-29b4-45a8-8d29-0eb29d698074 with Priority: HIGHEST for action port [ 1072.501824] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-27dd4e24-29b4-45a8-8d29-0eb29d698074 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.501824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27dd4e24-29b4-45a8-8d29-0eb29d698074" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.501824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27dd4e24-29b4-45a8-8d29-0eb29d698074" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.502403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27dd4e24-29b4-45a8-8d29-0eb29d698074" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.502403] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27dd4e24-29b4-45a8-8d29-0eb29d698074',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.005963] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27dd4e24-29b4-45a8-8d29-0eb29d698074 [ 1073.005963] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.005963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.006460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.006460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.006460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.006460] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27dd4e24-29b4-45a8-8d29-0eb29d698074 already deleted. [ 1073.006574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27dd4e24-29b4-45a8-8d29-0eb29d698074" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.338149] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1073.338149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.338149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.338149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.338149] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.338149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.338149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.338149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.338149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.338149] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.649056] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1073.649357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.649794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.649794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.649794] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.842041] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.842041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.842041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.842041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.842295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.842362] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.842475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.842561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.842738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.842827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.842916] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 1073.875317] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.875482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.875552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.876588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.876588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.890606] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1073.987021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 in Status: SUCCESS [ 1073.987021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.152670] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.153020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.153020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.153703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.153703] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.153885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.153885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.154018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.154132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.154232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.154367] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.662837] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.663211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.663375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.663621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.664020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.664172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.664332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.664765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.664917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.665103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.665431] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.665853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.665853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.665955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.666490] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.666490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.666490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.666683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.666819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.667012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.667233] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.171603] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2db7096a-5721-4998-9040-4834cd315121: rpc.has_security_group_logging(os_id): False [ 1075.191673] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.191895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.192020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.192238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.192354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.192636] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.192768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.192857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.193061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.193167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.193410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.193540] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.193628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.193813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.193915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.194230] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.194372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.194460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.194646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.194790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.194879] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1075.272046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.272046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.272046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.272046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.272046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.294190] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1075.623789] env[65899]: INFO networking_nsxv3.common.synchronization [None req-b374775e-2a42-41ff-b6f4-8eb8f2be8869 None None] Enqueued Resource ID: a277c3f3-128d-4a11-b350-52c78ac83a1a with Priority: HIGHEST for action port [ 1075.623789] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a277c3f3-128d-4a11-b350-52c78ac83a1a with Priority: HIGHEST for action port [ 1075.623789] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a277c3f3-128d-4a11-b350-52c78ac83a1a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.623789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a277c3f3-128d-4a11-b350-52c78ac83a1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.623789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a277c3f3-128d-4a11-b350-52c78ac83a1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.625865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a277c3f3-128d-4a11-b350-52c78ac83a1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.625865] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a277c3f3-128d-4a11-b350-52c78ac83a1a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.902336] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1075.902499] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d deletion is rescheduled due to dependency. [ 1075.902671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.127369] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a277c3f3-128d-4a11-b350-52c78ac83a1a [ 1076.127807] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.128130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.128311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.128611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.129080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.129080] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a277c3f3-128d-4a11-b350-52c78ac83a1a already deleted. [ 1076.129080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a277c3f3-128d-4a11-b350-52c78ac83a1a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.615032] env[65899]: INFO networking_nsxv3.common.synchronization [None req-56af17a9-d2b4-4b63-b9d6-0dd11e3208ae None None] Enqueued Resource ID: 8cd56f8e-b90d-43cd-86af-1768c0491c82 with Priority: HIGHEST for action port [ 1076.615800] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cd56f8e-b90d-43cd-86af-1768c0491c82 with Priority: HIGHEST for action port [ 1076.615944] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cd56f8e-b90d-43cd-86af-1768c0491c82 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.616540] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cd56f8e-b90d-43cd-86af-1768c0491c82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.616623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cd56f8e-b90d-43cd-86af-1768c0491c82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.616939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cd56f8e-b90d-43cd-86af-1768c0491c82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.617261] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cd56f8e-b90d-43cd-86af-1768c0491c82',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.120211] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cd56f8e-b90d-43cd-86af-1768c0491c82 [ 1077.120442] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.120569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.120639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.120841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.120923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.121099] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cd56f8e-b90d-43cd-86af-1768c0491c82 already deleted. [ 1077.121099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cd56f8e-b90d-43cd-86af-1768c0491c82" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.306858] env[65899]: INFO networking_nsxv3.common.synchronization [req-49b88d2c-5a84-436c-a999-003d05be8981 req-1e5d5163-c2fd-433a-93b3-bb5717e56781 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_members [ 1077.307413] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGHEST for action security_group_members [ 1077.308913] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.309080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.309377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.309377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.311077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.311077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.311077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.311077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.311077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.311077] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.316551] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1077.316551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.812852] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.812852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.812852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.812852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.812852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.813274] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.813274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.813274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.813274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.813399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.813399] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 is going to be updated. [ 1077.850769] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.850769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.850769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.850769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.851123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.866060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 in Status: IN_PROGRESS for 2s [ 1079.404848] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9af35f64-f98b-4204-94ba-149f93a59946 None None] Enqueued Resource ID: 066374e7-d0aa-417b-85f9-c656bc2f794c with Priority: HIGHEST for action port [ 1079.406336] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 066374e7-d0aa-417b-85f9-c656bc2f794c with Priority: HIGHEST for action port [ 1079.406954] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-066374e7-d0aa-417b-85f9-c656bc2f794c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.406954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-066374e7-d0aa-417b-85f9-c656bc2f794c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.406954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-066374e7-d0aa-417b-85f9-c656bc2f794c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.407233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-066374e7-d0aa-417b-85f9-c656bc2f794c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.407392] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('066374e7-d0aa-417b-85f9-c656bc2f794c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.877571] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 in Status: SUCCESS [ 1079.877942] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 deletion is rescheduled due to dependency. [ 1079.878158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.910637] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 066374e7-d0aa-417b-85f9-c656bc2f794c [ 1079.910637] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.910637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.910637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.910637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.910637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.910637] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:066374e7-d0aa-417b-85f9-c656bc2f794c already deleted. [ 1079.910637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-066374e7-d0aa-417b-85f9-c656bc2f794c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.888293] env[65899]: INFO networking_nsxv3.common.synchronization [None req-30173a92-51e0-4202-b9d7-d34abbfeb628 None None] Enqueued Resource ID: 8ac6d384-16e5-4333-a632-fecbf69da21b with Priority: HIGHEST for action port [ 1080.888293] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac6d384-16e5-4333-a632-fecbf69da21b with Priority: HIGHEST for action port [ 1080.888947] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ac6d384-16e5-4333-a632-fecbf69da21b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.889081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ac6d384-16e5-4333-a632-fecbf69da21b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.889119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ac6d384-16e5-4333-a632-fecbf69da21b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.889504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ac6d384-16e5-4333-a632-fecbf69da21b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.889504] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ac6d384-16e5-4333-a632-fecbf69da21b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.393263] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ac6d384-16e5-4333-a632-fecbf69da21b [ 1081.393263] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.393263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.393263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.393263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.393263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.393263] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ac6d384-16e5-4333-a632-fecbf69da21b already deleted. [ 1081.393263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ac6d384-16e5-4333-a632-fecbf69da21b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.864221] env[65899]: INFO networking_nsxv3.common.synchronization [req-1cd3bada-2797-49f9-9cbd-0a5a3c5e726c req-89095e52-3dd9-4f54-baa8-bd7a9fbdff6d tempest-ImagesTestJSON-202066077 tempest-ImagesTestJSON-202066077-project-member] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 1081.864835] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGHEST for action security_group_members [ 1081.865356] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.865473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.865563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.865784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.866370] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.866370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.866370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.866370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.866370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.866582] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.368919] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.369250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.369250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.369849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.369849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.369849] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.369849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.369849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.370042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.370042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.370117] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be updated. [ 1082.403215] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.403608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.403608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.403987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.404141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.412975] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: IN_PROGRESS for 2s [ 1082.717571] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3acafc5e-e523-48ea-86cb-2f239ae4efac tempest-ServersTestBootFromVolume-2100478652 tempest-ServersTestBootFromVolume-2100478652-project-member] Enqueued Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_rules [ 1082.718208] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_rules [ 1082.718681] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c86f328f-f619-4559-ae86-8793a284cfe3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.718681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.718814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.722736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.722866] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.900387] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9b8dcfd5-ffcd-4b9d-8307-48837622ad12 tempest-ServersTestBootFromVolume-2100478652 tempest-ServersTestBootFromVolume-2100478652-project-member] Enqueued Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_rules [ 1082.900387] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_rules [ 1082.901669] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c86f328f-f619-4559-ae86-8793a284cfe3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.902153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.246120] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.246324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.246464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.247185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.247185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.247381] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c86f328f-f619-4559-ae86-8793a284cfe3 already deleted. [ 1083.247381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.247713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.247874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.247986] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.762808] env[65899]: INFO networking_nsxv3.common.synchronization [None req-bed3ef06-7741-4a40-92be-23f54458a496 None None] Enqueued Resource ID: deba959f-a7da-4e86-847e-a2a909356fbf with Priority: HIGHEST for action port [ 1083.763387] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deba959f-a7da-4e86-847e-a2a909356fbf with Priority: HIGHEST for action port [ 1083.764829] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-deba959f-a7da-4e86-847e-a2a909356fbf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.765213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deba959f-a7da-4e86-847e-a2a909356fbf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.765213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deba959f-a7da-4e86-847e-a2a909356fbf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.765479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deba959f-a7da-4e86-847e-a2a909356fbf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.765788] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deba959f-a7da-4e86-847e-a2a909356fbf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.773872] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.774092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.774201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.774453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.774577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.774714] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c86f328f-f619-4559-ae86-8793a284cfe3 already deleted. [ 1083.775072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.862442] env[65899]: INFO networking_nsxv3.common.synchronization [req-2538ee0b-d1f7-403e-a074-bb98ca295dfc req-f7be757d-b79f-4530-812b-9f6e777c6718 tempest-ServersNegativeTestJSON-2131427321 tempest-ServersNegativeTestJSON-2131427321-project-member] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1083.863498] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1083.863498] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.863686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.863686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.864871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.864871] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.864871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.864871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.865192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.865192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.865192] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.268733] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deba959f-a7da-4e86-847e-a2a909356fbf [ 1084.269313] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.269534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.269634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.269873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.269971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.270098] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deba959f-a7da-4e86-847e-a2a909356fbf already deleted. [ 1084.270247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deba959f-a7da-4e86-847e-a2a909356fbf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.293874] env[65899]: INFO networking_nsxv3.common.synchronization [None req-cbf8023d-76ab-4580-bd70-19af5ceeb68d None None] Enqueued Resource ID: 41da3b73-a388-4384-9758-40acfe7f3e77 with Priority: HIGHEST for action port [ 1084.294596] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41da3b73-a388-4384-9758-40acfe7f3e77 with Priority: HIGHEST for action port [ 1084.295081] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-41da3b73-a388-4384-9758-40acfe7f3e77 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.295561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41da3b73-a388-4384-9758-40acfe7f3e77" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.298020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41da3b73-a388-4384-9758-40acfe7f3e77" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.298020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41da3b73-a388-4384-9758-40acfe7f3e77" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.298020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41da3b73-a388-4384-9758-40acfe7f3e77',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.369979] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.369979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.369979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.369979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.370293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.370293] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.370293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.370471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.370518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.370576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.370643] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 already deleted. [ 1084.370717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.425629] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 in Status: SUCCESS [ 1084.425851] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 deletion is rescheduled due to dependency. [ 1084.426157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.431357] env[65899]: INFO networking_nsxv3.common.synchronization [req-03213240-6509-44e3-a70d-c6734b920cb6 req-9259e5d7-2814-463c-9a07-ebb8b32b9c96 tempest-AttachVolumeShelveTestJSON-1192841755 tempest-AttachVolumeShelveTestJSON-1192841755-project-member] Enqueued Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_members [ 1084.432136] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f with Priority: HIGHEST for action security_group_members [ 1084.432297] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e8e18e2-41de-44dd-a97f-655de1cca16f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.432419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.432483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.432947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.432947] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.432947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.433133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.433133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.434801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.434801] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e8e18e2-41de-44dd-a97f-655de1cca16f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.801344] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41da3b73-a388-4384-9758-40acfe7f3e77 [ 1084.801344] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.801344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.801344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.801344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.801344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.802284] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41da3b73-a388-4384-9758-40acfe7f3e77 already deleted. [ 1084.802284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41da3b73-a388-4384-9758-40acfe7f3e77" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.935959] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.936220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.936220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.936530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.936739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.937010] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.937210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.937267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.937415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.937490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.937600] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f is going to be updated. [ 1084.978246] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.978531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.978531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.978666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.978829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.992843] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: IN_PROGRESS for 2s [ 1085.036132] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.037378] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.037718] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.038198] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.038650] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.039027] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.039285] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.039666] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.039949] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.040314] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.040565] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.040850] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.041119] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.041354] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.041570] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.041813] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.073461] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.073461] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.073461] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.073461] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.073461] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-48c09a80-06ab-4b73-b5b1-2c861f6ee447 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.073461] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.073461] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.073770] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.073901] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48c09a80-06ab-4b73-b5b1-2c861f6ee447',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.577212] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.577482] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.577638] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.577915] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.578072] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.578224] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 48c09a80-06ab-4b73-b5b1-2c861f6ee447 not found, creating... [ 1085.578495] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.578643] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.578841] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.578965] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.579132] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.579553] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.582018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.582018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.582018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.582018] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.582018] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 48c09a80-06ab-4b73-b5b1-2c861f6ee447 is going to be created. [ 1085.611295] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.611295] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.611295] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.611295] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.611647] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.611732] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.691978] env[65899]: INFO networking_nsxv3.common.synchronization [req-a9d6e3ec-e4ef-4742-ab11-e99289d4134b req-b9c7a639-b1b6-4950-8e13-b12e8080041e tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1085.692199] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1085.692942] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.692942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.692942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.693505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.693679] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.694149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.694149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.694711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.694711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.694810] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.914088] env[65899]: INFO networking_nsxv3.common.synchronization [req-ba50ec74-7780-4fa1-8413-7e2ce2fb7e1d req-8dc86b83-1709-4100-b703-7a3c549ff1ba tempest-ServerGroupTestJSON-567335715 tempest-ServerGroupTestJSON-567335715-project-member] Enqueued Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGHEST for action security_group_members [ 1085.914772] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGHEST for action security_group_members [ 1085.915980] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.915980] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.916152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.917284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.917284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.917561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.917624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.917868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.918078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.918509] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.199198] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.275275] env[65899]: INFO networking_nsxv3.common.synchronization [None req-2da07fbc-48b4-4930-9b19-b5c902306d32 None None] Enqueued Resource ID: 10c66b47-7acb-4e58-9fd7-6be60b499f0d with Priority: HIGHEST for action port [ 1086.275275] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c66b47-7acb-4e58-9fd7-6be60b499f0d with Priority: HIGHEST for action port [ 1086.275400] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-10c66b47-7acb-4e58-9fd7-6be60b499f0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.275473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10c66b47-7acb-4e58-9fd7-6be60b499f0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.275541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10c66b47-7acb-4e58-9fd7-6be60b499f0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.275793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10c66b47-7acb-4e58-9fd7-6be60b499f0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.275899] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10c66b47-7acb-4e58-9fd7-6be60b499f0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.289240] env[65899]: INFO networking_nsxv3.common.synchronization [req-a9d6e3ec-e4ef-4742-ab11-e99289d4134b req-b55d7bbf-15c3-4f5a-97e2-996e78353280 tempest-ServersTestMultiNic-1936281483 tempest-ServersTestMultiNic-1936281483-project-member] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1086.289240] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGHEST for action security_group_members [ 1086.289240] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.289240] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.419510] env[65899]: INFO networking_nsxv3.common.synchronization [req-2538ee0b-d1f7-403e-a074-bb98ca295dfc req-4ab1c674-29ea-45d8-8d33-c2170d922eb1 service nova] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_rules [ 1086.419695] env[65899]: INFO networking_nsxv3.common.synchronization [req-2538ee0b-d1f7-403e-a074-bb98ca295dfc req-4ab1c674-29ea-45d8-8d33-c2170d922eb1 service nova] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1086.419827] env[65899]: INFO networking_nsxv3.common.synchronization [req-2538ee0b-d1f7-403e-a074-bb98ca295dfc req-4ab1c674-29ea-45d8-8d33-c2170d922eb1 service nova] Enqueued Resource ID: 48c09a80-06ab-4b73-b5b1-2c861f6ee447 with Priority: HIGHEST for action port [ 1086.420396] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_rules [ 1086.420489] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1086.421324] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09a80-06ab-4b73-b5b1-2c861f6ee447 with Priority: HIGHEST for action port [ 1086.421324] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.421324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.421324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.421570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.421646] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.422511] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.422637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.422675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.423878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.423878] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.423878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.423878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.423878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.423878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.423878] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.424303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.424303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.424382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.424952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.424952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.424952] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.425246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.425246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.425308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.425339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.425423] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 is going to be updated. [ 1086.426510] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-48c09a80-06ab-4b73-b5b1-2c861f6ee447 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.426612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.426706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.426838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.426905] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48c09a80-06ab-4b73-b5b1-2c861f6ee447',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.478816] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.478985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.479167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.479412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.479558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.514358] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 in Status: IN_PROGRESS for 2s [ 1086.705859] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.780792] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10c66b47-7acb-4e58-9fd7-6be60b499f0d [ 1086.781043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.781171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.781236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.781631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.781631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.781764] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10c66b47-7acb-4e58-9fd7-6be60b499f0d already deleted. [ 1086.781764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10c66b47-7acb-4e58-9fd7-6be60b499f0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.928493] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.929729] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.929729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.929929] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48c09a80-06ab-4b73-b5b1-2c861f6ee447 with status ACTIVE [ 1086.929929] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.933239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.934501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.934501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.934501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.936328] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.936328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.936328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.936469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.938716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.938716] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.938716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.938716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.938716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.938716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.938716] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48c09a80-06ab-4b73-b5b1-2c861f6ee447 is going to be updated. [ 1086.965094] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.966561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.966561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.966561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.966561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.966561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.004532] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f in Status: SUCCESS [ 1087.004733] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e8e18e2-41de-44dd-a97f-655de1cca16f deletion is rescheduled due to dependency. [ 1087.004846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e8e18e2-41de-44dd-a97f-655de1cca16f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.209326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.209570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.209643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.210533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.210533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.210533] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1087.263621] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.264178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.264178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.264588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.264806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.282598] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1087.439725] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.942193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.942632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.942632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.942735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.942977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.942977] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be created. [ 1087.975913] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.976247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.976328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.976715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.976896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.990171] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: UNINITIALIZED for 2s [ 1088.524449] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 in Status: SUCCESS [ 1088.524665] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 deletion is rescheduled due to dependency. [ 1088.524785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.721772] env[65899]: INFO networking_nsxv3.common.synchronization [req-cc0cf9cd-e199-4efc-b7e3-df54f1971ce4 req-cadc7912-942d-4da5-b855-5031d8a823ed tempest-ServersV294TestFqdnHostnames-376433348 tempest-ServersV294TestFqdnHostnames-376433348-project-member] Enqueued Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_members [ 1088.722375] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGHEST for action security_group_members [ 1088.722776] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-35157e46-cf93-4f9c-919b-4023c4f96551 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.723812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.723812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.723812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.723991] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.723991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.724150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.724550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.724718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.724904] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.133664] env[65899]: INFO networking_nsxv3.common.synchronization [None req-7b94c879-c762-44a6-bbf5-68dc86bf9673 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_rules [ 1089.134309] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_rules [ 1089.134615] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.134731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.134796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.135647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.135647] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.221714] env[65899]: INFO networking_nsxv3.common.synchronization [None req-166cb319-2863-4ed6-b1af-4b7adb88f2c0 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_rules [ 1089.223631] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_rules [ 1089.223631] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.223631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.227554] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.228570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.228570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.228570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.228570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.228570] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.228570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.228570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.228570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.228570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.228947] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35157e46-cf93-4f9c-919b-4023c4f96551 is going to be updated. [ 1089.261185] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.261581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.261782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.262125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.262373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.276146] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35157e46-cf93-4f9c-919b-4023c4f96551 in Status: IN_PROGRESS for 2s [ 1089.292291] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1089.292551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.292971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.293227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.293428] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.293535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.293600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.293769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.294013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.294158] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.626108] env[65899]: INFO networking_nsxv3.common.synchronization [req-76d8063b-db78-46f9-a504-316635173fda req-2e51058e-1982-47d9-8cd6-d3fe2e82b645 tempest-ServerMetadataTestJSON-1061098529 tempest-ServerMetadataTestJSON-1061098529-project-member] Enqueued Resource ID: 159662e6-8d8b-459e-af18-9590760ed457 with Priority: HIGHEST for action security_group_members [ 1089.626694] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159662e6-8d8b-459e-af18-9590760ed457 with Priority: HIGHEST for action security_group_members [ 1089.628561] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-159662e6-8d8b-459e-af18-9590760ed457 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.628805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.629236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.629961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.630195] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.630357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.630480] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.630794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.630927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.631077] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159662e6-8d8b-459e-af18-9590760ed457',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.658074] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.658292] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.658292] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.658510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.658592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.658721] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a73361-0065-4c2b-847b-544a63c06efc already deleted. [ 1089.658851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.659407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.659590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.660647] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.798114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.798114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.798114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.798519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.798519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.802673] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.803912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.803912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.803912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.804149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.804200] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be updated. [ 1089.845445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.845445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.845445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.845767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.845834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.883217] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: IN_PROGRESS for 2s [ 1090.000732] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1090.000944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.000944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.001163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.001357] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.002739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.002739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.002739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.002739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.002739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.002739] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.055131] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-172 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.055328] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-172" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.055449] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-172" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.056183] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-172" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.056183] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.056413] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.056413] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.056588] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.056700] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.056950] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1090.057076] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.057183] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.057285] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.057392] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1090.057496] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.057641] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.079746] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.079972] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1090.080068] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.080481] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-172" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.080640] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.080719] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.080814] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.081141] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.081279] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0bdb0d6-8183-4109-a46d-5d7f13b1551d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.134151] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.134151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.134151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.134151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.134651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.134651] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.134651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.134651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.134801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.134801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.134883] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159662e6-8d8b-459e-af18-9590760ed457 already deleted. [ 1090.134883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.182549] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.182701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.182772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.182983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.183107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.183249] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a73361-0065-4c2b-847b-544a63c06efc already deleted. [ 1090.183355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.505041] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.505197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.505265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.507093] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.507093] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.507093] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.507093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.507693] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.584644] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.584644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.584644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.584644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.584831] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.585011] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port b0bdb0d6-8183-4109-a46d-5d7f13b1551d not found, creating... [ 1090.585625] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.585738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.585928] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.586397] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.586513] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.587013] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.587290] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.587469] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.587742] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.587901] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.588115] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: b0bdb0d6-8183-4109-a46d-5d7f13b1551d is going to be created. [ 1090.616234] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.616464] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.616752] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.617502] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.617502] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.617502] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.009697] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd672f3d-6117-44aa-8b2f-40dde93f9373: rpc.has_security_group_logging(os_id): False [ 1091.047160] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.047442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.047442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.047946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.048111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.048387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.048494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.048565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.048853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.048952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.049266] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.049363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.049427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.049631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.049748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.049970] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.050082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.050130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.050395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.050437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.050545] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be created. [ 1091.135761] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.136135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.136135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.136266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.136515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.151948] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1091.294123] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35157e46-cf93-4f9c-919b-4023c4f96551 in Status: SUCCESS [ 1091.295221] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35157e46-cf93-4f9c-919b-4023c4f96551 deletion is rescheduled due to dependency. [ 1091.295221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.451038] env[65899]: INFO networking_nsxv3.common.synchronization [req-76d8063b-db78-46f9-a504-316635173fda req-1a6d83db-2414-4bd3-96b6-b2a6efd356b7 service nova] Enqueued Resource ID: 159662e6-8d8b-459e-af18-9590760ed457 with Priority: HIGHEST for action security_group_rules [ 1091.451038] env[65899]: INFO networking_nsxv3.common.synchronization [req-76d8063b-db78-46f9-a504-316635173fda req-1a6d83db-2414-4bd3-96b6-b2a6efd356b7 service nova] Enqueued Resource ID: 159662e6-8d8b-459e-af18-9590760ed457 with Priority: HIGHEST for action security_group_members [ 1091.451038] env[65899]: INFO networking_nsxv3.common.synchronization [req-76d8063b-db78-46f9-a504-316635173fda req-1a6d83db-2414-4bd3-96b6-b2a6efd356b7 service nova] Enqueued Resource ID: b0bdb0d6-8183-4109-a46d-5d7f13b1551d with Priority: HIGHEST for action port [ 1091.451038] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159662e6-8d8b-459e-af18-9590760ed457 with Priority: HIGHEST for action security_group_rules [ 1091.451038] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159662e6-8d8b-459e-af18-9590760ed457 with Priority: HIGHEST for action security_group_members [ 1091.451038] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0bdb0d6-8183-4109-a46d-5d7f13b1551d with Priority: HIGHEST for action port [ 1091.451038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-159662e6-8d8b-459e-af18-9590760ed457 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.451711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.451711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.451711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.451711] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('159662e6-8d8b-459e-af18-9590760ed457',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.453548] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-159662e6-8d8b-459e-af18-9590760ed457 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.453679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.453740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.453943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.455185] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.455185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.455185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.455185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.455185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.455185] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159662e6-8d8b-459e-af18-9590760ed457',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.460937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.461169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.461169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.461359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.461573] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0bdb0d6-8183-4109-a46d-5d7f13b1551d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.894716] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2db7096a-5721-4998-9040-4834cd315121 in Status: SUCCESS [ 1091.894890] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2db7096a-5721-4998-9040-4834cd315121 deletion is rescheduled due to dependency. [ 1091.895024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.963985] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-159662e6-8d8b-459e-af18-9590760ed457 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.964224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.964522] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('159662e6-8d8b-459e-af18-9590760ed457',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.965856] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0bdb0d6-8183-4109-a46d-5d7f13b1551d with status ACTIVE [ 1091.966171] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.966351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.966441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.966742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.966918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.967214] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.967384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.967494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.967755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.967894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.968292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.968377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.968468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.968898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.968898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.969045] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0bdb0d6-8183-4109-a46d-5d7f13b1551d is going to be updated. [ 1091.994823] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.995052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.995130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.995348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.995513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.996254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0bdb0d6-8183-4109-a46d-5d7f13b1551d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.471693] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('159662e6-8d8b-459e-af18-9590760ed457',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.977612] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.977792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.977840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.978119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.978250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.978336] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159662e6-8d8b-459e-af18-9590760ed457 is going to be created. [ 1093.015657] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.015825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.015825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.016769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.017143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.031634] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159662e6-8d8b-459e-af18-9590760ed457 in Status: UNINITIALIZED for 2s [ 1093.167771] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1093.168172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.018210] env[65899]: INFO networking_nsxv3.common.synchronization [None req-89bd08f6-c540-4727-9330-29a4c3cad61a tempest-AttachVolumeShelveTestJSON-1192841755 tempest-AttachVolumeShelveTestJSON-1192841755-project-member] Enqueued Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_rules [ 1095.020809] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_rules [ 1095.020809] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.020809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.020809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.020809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.020809] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.046767] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159662e6-8d8b-459e-af18-9590760ed457 in Status: SUCCESS [ 1095.046962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.047391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.047654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.047880] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.048087] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.048184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.048404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.048544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.048610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.048662] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('159662e6-8d8b-459e-af18-9590760ed457',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.153072] env[65899]: INFO networking_nsxv3.common.synchronization [None req-f04ee4ef-1719-42e9-8c25-82460905bb10 tempest-AttachVolumeShelveTestJSON-1192841755 tempest-AttachVolumeShelveTestJSON-1192841755-project-member] Enqueued Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_rules [ 1095.153072] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_rules [ 1095.153072] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.153072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.543669] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.543869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.543943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.544136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.544222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.544319] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d already deleted. [ 1095.544400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.544546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.544693] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.544772] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.555028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-159662e6-8d8b-459e-af18-9590760ed457 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.555028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.555028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-159662e6-8d8b-459e-af18-9590760ed457 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.555028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.555028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.555666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.555666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.555666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.555666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.555666] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('159662e6-8d8b-459e-af18-9590760ed457',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.059112] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 159662e6-8d8b-459e-af18-9590760ed457: rpc.has_security_group_logging(os_id): False [ 1096.075474] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.075628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.075697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.075949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.076062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.076163] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d already deleted. [ 1096.076244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.086950] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.087178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.087248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.087441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.087634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.087835] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.087939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.088069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.088270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.088377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.088602] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.088717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.088799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.088962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.089050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.089255] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.089343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.089376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.089551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.089664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.089818] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 159662e6-8d8b-459e-af18-9590760ed457 is going to be created. [ 1096.157444] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.158324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.158324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.158324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.158324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.171057] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 159662e6-8d8b-459e-af18-9590760ed457 in Status: IN_PROGRESS for 2s [ 1098.097598] env[65899]: INFO networking_nsxv3.common.synchronization [None req-4a8c80b6-9951-4939-97b4-ccd3bda3759d tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: c373da8f-d5ef-4cba-a4f1-f4bd8499b6af with Priority: HIGHEST for action security_group_rules [ 1098.098198] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c373da8f-d5ef-4cba-a4f1-f4bd8499b6af with Priority: HIGHEST for action security_group_rules [ 1098.098475] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.098598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.098673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.099016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.099301] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c373da8f-d5ef-4cba-a4f1-f4bd8499b6af',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.187573] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 159662e6-8d8b-459e-af18-9590760ed457 in Status: SUCCESS [ 1098.187910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.304568] env[65899]: INFO networking_nsxv3.common.synchronization [None req-8c2a1999-7dad-493d-a013-da44670c0799 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: c373da8f-d5ef-4cba-a4f1-f4bd8499b6af with Priority: HIGHEST for action security_group_rules [ 1098.305187] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c373da8f-d5ef-4cba-a4f1-f4bd8499b6af with Priority: HIGHEST for action security_group_rules [ 1098.305514] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.305631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.623838] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.623838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.623838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.623838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.623838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.623838] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c373da8f-d5ef-4cba-a4f1-f4bd8499b6af already deleted. [ 1098.623838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.623838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.623838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.623838] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c373da8f-d5ef-4cba-a4f1-f4bd8499b6af',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.912409] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9d6c080a-0c6b-4da0-a959-4704ddf47bb4 None None] Enqueued Resource ID: 798f8956-d26b-4c9a-89bf-1927187aa150 with Priority: HIGHEST for action port [ 1098.912409] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 798f8956-d26b-4c9a-89bf-1927187aa150 with Priority: HIGHEST for action port [ 1098.912409] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-798f8956-d26b-4c9a-89bf-1927187aa150 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.912409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-798f8956-d26b-4c9a-89bf-1927187aa150" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.912711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-798f8956-d26b-4c9a-89bf-1927187aa150" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.914322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-798f8956-d26b-4c9a-89bf-1927187aa150" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.914322] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('798f8956-d26b-4c9a-89bf-1927187aa150',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.144833] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.144833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.144833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.144833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.144833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.144833] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c373da8f-d5ef-4cba-a4f1-f4bd8499b6af already deleted. [ 1099.145510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c373da8f-d5ef-4cba-a4f1-f4bd8499b6af" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.417027] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 798f8956-d26b-4c9a-89bf-1927187aa150 [ 1099.417027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.417027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.417027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.417027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.417027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.417027] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:798f8956-d26b-4c9a-89bf-1927187aa150 already deleted. [ 1099.417027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-798f8956-d26b-4c9a-89bf-1927187aa150" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.384852] env[65899]: INFO networking_nsxv3.common.synchronization [req-82ab43fd-e911-4d68-b2ee-aed48d199df9 req-cd79fea6-224a-4af5-baa2-b4678d5ab28f tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1101.385623] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1101.386166] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.386631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.386631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.386631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.386762] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.386873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.386936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.387131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.387238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.387345] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.849641] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.849961] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.850147] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.850488] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.850923] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.851045] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.851340] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.851504] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.851816] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.852206] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.852439] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.852634] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.852861] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.853154] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.853326] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.853498] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.874634] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.875150] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.875451] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.875750] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.877311] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.877311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.877311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.877311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.877311] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93d6c083-eb7b-4d0f-b15a-3922f6bf4362',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.889396] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.890555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.890555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.890555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.890555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.894226] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.894389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.894624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.894685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.894722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.894805] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1101.923587] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.923764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.924029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.924029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.924194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.933342] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1102.025522] env[65899]: INFO networking_nsxv3.common.synchronization [req-891eae7c-5665-4e5f-be3c-5d36c5af2124 req-94c10656-0b3b-4f8c-a0fe-a8cf07e59df5 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1102.025671] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1102.026012] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.026153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.026221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.026421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.026576] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.026672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.026732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.026879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.026964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.027070] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.253121] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9179b975-3fce-467d-ab67-f0fde73c3e68 None None] Enqueued Resource ID: 3f96b444-fcd1-4370-be4f-3d133a18313b with Priority: HIGHEST for action port [ 1102.253376] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f96b444-fcd1-4370-be4f-3d133a18313b with Priority: HIGHEST for action port [ 1102.254624] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f96b444-fcd1-4370-be4f-3d133a18313b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.254624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f96b444-fcd1-4370-be4f-3d133a18313b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.254624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f96b444-fcd1-4370-be4f-3d133a18313b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.254904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f96b444-fcd1-4370-be4f-3d133a18313b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.254904] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f96b444-fcd1-4370-be4f-3d133a18313b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.380132] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.380476] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.380673] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.381105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.381338] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.381557] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 93d6c083-eb7b-4d0f-b15a-3922f6bf4362 not found, creating... [ 1102.381956] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.382211] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.382382] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.382725] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.382886] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.385929] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.386334] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.387728] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.387909] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.388055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.388260] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 93d6c083-eb7b-4d0f-b15a-3922f6bf4362 is going to be created. [ 1102.417384] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.417596] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.417718] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.418011] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.418287] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.418469] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.529392] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.529893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.529998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.530277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.530457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.530654] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.530767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.530820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.530982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.531069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.531158] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1102.570983] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.571162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.571203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.571406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.571543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.583889] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1102.756617] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f96b444-fcd1-4370-be4f-3d133a18313b [ 1102.756855] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.756994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.757105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.757331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.757421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.757521] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f96b444-fcd1-4370-be4f-3d133a18313b already deleted. [ 1102.757600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f96b444-fcd1-4370-be4f-3d133a18313b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.192054] env[65899]: INFO networking_nsxv3.common.synchronization [req-82ab43fd-e911-4d68-b2ee-aed48d199df9 req-f58434c2-b460-4e19-a902-9cde2f4d4e06 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1103.192054] env[65899]: INFO networking_nsxv3.common.synchronization [req-82ab43fd-e911-4d68-b2ee-aed48d199df9 req-f58434c2-b460-4e19-a902-9cde2f4d4e06 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1103.192054] env[65899]: INFO networking_nsxv3.common.synchronization [req-82ab43fd-e911-4d68-b2ee-aed48d199df9 req-f58434c2-b460-4e19-a902-9cde2f4d4e06 service nova] Enqueued Resource ID: 93d6c083-eb7b-4d0f-b15a-3922f6bf4362 with Priority: HIGHEST for action port [ 1103.192246] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1103.192246] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1103.192380] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d6c083-eb7b-4d0f-b15a-3922f6bf4362 with Priority: HIGHEST for action port [ 1103.192618] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.192735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.192801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.192997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.193086] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.193946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.194049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.194228] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.194329] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.194509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.194622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.194673] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93d6c083-eb7b-4d0f-b15a-3922f6bf4362',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.696728] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.696728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.697181] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93d6c083-eb7b-4d0f-b15a-3922f6bf4362 with status ACTIVE [ 1103.697181] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.697181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.697344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.697458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.697548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.697723] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.697837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.697891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.698477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.698477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.698477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.698477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.698477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.698736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.698736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.698736] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93d6c083-eb7b-4d0f-b15a-3922f6bf4362 is going to be updated. [ 1103.732077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.732077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.732077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.732077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.732077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.732077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93d6c083-eb7b-4d0f-b15a-3922f6bf4362" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.943288] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1103.943288] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1103.943498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.943578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.943825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.944123] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.944272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.944434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.944549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.944700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.944748] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.448714] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.596471] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1104.596775] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b deletion is rescheduled due to dependency. [ 1104.596913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.951590] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.454237] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.454424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.454487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.455071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.455071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.455071] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1105.484954] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.485175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.485175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.485385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.485553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.495461] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1107.512082] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1107.512374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.512511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.512825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.513077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.513167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.513231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.513388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.513606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.513606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.513689] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.015630] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.015836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.015934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.016289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.016511] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.016655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.016745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.017023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.017163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.017982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.017982] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.017982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.017982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.017982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.018218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.018664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.018664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.018823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.018949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.019092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.019239] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.193431] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1108.193626] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1108.523438] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3990baf0-9e24-4b70-8c31-60cf273fe344: rpc.has_security_group_logging(os_id): False [ 1108.540115] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.540115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.540115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.540425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.540425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.540567] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.540658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.541028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.541028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.541028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.541189] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.541246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.541285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.541397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.541466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.541658] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.541748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.541806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.541938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.542012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.542096] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1108.609159] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.609333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.609391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.609648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.609807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.626166] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1109.103272] env[65899]: INFO networking_nsxv3.common.synchronization [req-f1ceb98a-e19d-4abb-84f0-8dc3bf4005f0 req-62fe8b58-2691-45dd-b0ca-6fb5e1bd73c2 tempest-ServerTagsTestJSON-540486860 tempest-ServerTagsTestJSON-540486860-project-member] Enqueued Resource ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 with Priority: HIGHEST for action security_group_members [ 1109.104506] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 with Priority: HIGHEST for action security_group_members [ 1109.104936] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-79256018-f240-48eb-94f9-bc8b0119d8f5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.105439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.105525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.106597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.106597] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.106597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.106597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.106597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.106932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.107079] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79256018-f240-48eb-94f9-bc8b0119d8f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.465419] env[65899]: INFO networking_nsxv3.common.synchronization [None req-10c95273-35e1-4be9-af10-6e0b72710e9b None None] Enqueued Resource ID: 42628dc0-3e52-455d-ac9e-07403a8d296a with Priority: HIGHEST for action port [ 1109.466101] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42628dc0-3e52-455d-ac9e-07403a8d296a with Priority: HIGHEST for action port [ 1109.466414] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-42628dc0-3e52-455d-ac9e-07403a8d296a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.466565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42628dc0-3e52-455d-ac9e-07403a8d296a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.466657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42628dc0-3e52-455d-ac9e-07403a8d296a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.466995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42628dc0-3e52-455d-ac9e-07403a8d296a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.467134] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42628dc0-3e52-455d-ac9e-07403a8d296a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.530780] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.531321] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-903" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.531321] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-903" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.531521] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-903" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.531829] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.531829] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.532157] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.532244] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.532422] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.532744] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.532744] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.532936] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.532998] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.533077] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.533219] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.533353] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.557662] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.557846] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.557976] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.558175] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-903" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.558536] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-5c35201b-3efc-432b-8b3a-f6ae902d3456 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.558724] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-5c35201b-3efc-432b-8b3a-f6ae902d3456" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.558865] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-5c35201b-3efc-432b-8b3a-f6ae902d3456" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.559430] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-5c35201b-3efc-432b-8b3a-f6ae902d3456" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.559665] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c35201b-3efc-432b-8b3a-f6ae902d3456',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.609647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.609884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.609884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.610099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.610200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.610399] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.610497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.610559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.610703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.610776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.610857] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 already deleted. [ 1109.610935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.801646] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1109.801922] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent loop - iteration:2 started [ 1109.961252] env[65899]: INFO networking_nsxv3.common.synchronization [req-01d40115-4008-446b-a50d-1af2f045ad15 req-8afe82de-b455-4dec-bc85-497724e0260a tempest-ServerMetadataTestJSON-1061098529 tempest-ServerMetadataTestJSON-1061098529-project-member] Enqueued Resource ID: 159662e6-8d8b-459e-af18-9590760ed457 with Priority: HIGHEST for action security_group_members [ 1109.961777] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159662e6-8d8b-459e-af18-9590760ed457 with Priority: HIGHEST for action security_group_members [ 1109.962401] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-159662e6-8d8b-459e-af18-9590760ed457 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.962505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.962662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.962744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.962896] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.963071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.963071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.963307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.963307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.963417] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159662e6-8d8b-459e-af18-9590760ed457',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.969095] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42628dc0-3e52-455d-ac9e-07403a8d296a [ 1109.969312] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.969456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.969456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.969745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.969846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.969964] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42628dc0-3e52-455d-ac9e-07403a8d296a already deleted. [ 1109.970042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42628dc0-3e52-455d-ac9e-07403a8d296a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.064635] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.064902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.065048] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.066250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.066250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.066250] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 5c35201b-3efc-432b-8b3a-f6ae902d3456 not found, creating... [ 1110.066250] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.066250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.066250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.066526] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.066679] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.068033] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.068297] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.068496] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.068812] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.069055] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.069385] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 5c35201b-3efc-432b-8b3a-f6ae902d3456 is going to be created. [ 1110.090838] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.091164] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.091251] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.091665] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.091817] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.092325] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-5c35201b-3efc-432b-8b3a-f6ae902d3456" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.240645] env[65899]: INFO networking_nsxv3.common.synchronization [req-e4ec2cf0-f2d5-4712-8de9-3835463cdfd9 req-f99170b4-2eae-4e39-86e7-432ad75d8161 tempest-ServersAdminTestJSON-2084545516 tempest-ServersAdminTestJSON-2084545516-project-member] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1110.240645] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1110.240645] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.240645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.240645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.240645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.241060] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.241319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.241502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.241767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.241945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.242142] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.466441] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.466579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.466653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.466850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.466937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.467163] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.467274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.467327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.467458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.467539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.467625] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159662e6-8d8b-459e-af18-9590760ed457 is going to be updated. [ 1110.500131] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.500346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.500346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.500550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.500697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.513950] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159662e6-8d8b-459e-af18-9590760ed457 in Status: IN_PROGRESS for 2s [ 1110.652660] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1110.653044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.744447] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.845742] env[65899]: INFO networking_nsxv3.common.synchronization [req-f1ceb98a-e19d-4abb-84f0-8dc3bf4005f0 req-a1280cae-39de-4a47-9641-a076f257c862 service nova] Enqueued Resource ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 with Priority: HIGHEST for action security_group_rules [ 1110.846296] env[65899]: INFO networking_nsxv3.common.synchronization [req-f1ceb98a-e19d-4abb-84f0-8dc3bf4005f0 req-a1280cae-39de-4a47-9641-a076f257c862 service nova] Enqueued Resource ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 with Priority: HIGHEST for action security_group_members [ 1110.846296] env[65899]: INFO networking_nsxv3.common.synchronization [req-f1ceb98a-e19d-4abb-84f0-8dc3bf4005f0 req-a1280cae-39de-4a47-9641-a076f257c862 service nova] Enqueued Resource ID: 5c35201b-3efc-432b-8b3a-f6ae902d3456 with Priority: HIGHEST for action port [ 1110.846645] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 with Priority: HIGHEST for action security_group_rules [ 1110.846774] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 with Priority: HIGHEST for action security_group_members [ 1110.849662] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c35201b-3efc-432b-8b3a-f6ae902d3456 with Priority: HIGHEST for action port [ 1110.849662] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79256018-f240-48eb-94f9-bc8b0119d8f5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.849662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.849662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.849662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.849662] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79256018-f240-48eb-94f9-bc8b0119d8f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.850690] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-79256018-f240-48eb-94f9-bc8b0119d8f5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.850837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.850974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.851237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.851431] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.851555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.851616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.852112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.852374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.852717] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79256018-f240-48eb-94f9-bc8b0119d8f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.853497] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c35201b-3efc-432b-8b3a-f6ae902d3456 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.853682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c35201b-3efc-432b-8b3a-f6ae902d3456" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.854439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c35201b-3efc-432b-8b3a-f6ae902d3456" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.854439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c35201b-3efc-432b-8b3a-f6ae902d3456" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.854439] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c35201b-3efc-432b-8b3a-f6ae902d3456',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.248381] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.356319] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-79256018-f240-48eb-94f9-bc8b0119d8f5 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.356488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.356632] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c35201b-3efc-432b-8b3a-f6ae902d3456 with status ACTIVE [ 1111.356715] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.356921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.356921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.357145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.357235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.357410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.357502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.357559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.357699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.357769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.357947] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.358060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.358119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.358256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.358326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.358406] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c35201b-3efc-432b-8b3a-f6ae902d3456 is going to be updated. [ 1111.359477] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79256018-f240-48eb-94f9-bc8b0119d8f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.382190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.382334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.382403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.382609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.382819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.382987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c35201b-3efc-432b-8b3a-f6ae902d3456" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.751811] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.752147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.752147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.752252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.752335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.752430] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1111.807212] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.807630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.807845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.808242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.808754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.819130] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1111.862795] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79256018-f240-48eb-94f9-bc8b0119d8f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.180628] env[65899]: INFO networking_nsxv3.common.synchronization [None req-4c1e080d-0f01-4fef-8f60-e15fa6fe0b39 None None] Enqueued Resource ID: 6a8a26db-933d-48c6-81a3-eca3b8876404 with Priority: HIGHEST for action port [ 1112.181397] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a8a26db-933d-48c6-81a3-eca3b8876404 with Priority: HIGHEST for action port [ 1112.181592] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a8a26db-933d-48c6-81a3-eca3b8876404 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.181728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a8a26db-933d-48c6-81a3-eca3b8876404" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.181876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a8a26db-933d-48c6-81a3-eca3b8876404" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.182064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a8a26db-933d-48c6-81a3-eca3b8876404" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.182131] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a8a26db-933d-48c6-81a3-eca3b8876404',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.368350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.368562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.368612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.368790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.368874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.368970] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 is going to be created. [ 1112.396736] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.396928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.397020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.397208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.397360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.407684] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 in Status: UNINITIALIZED for 2s [ 1112.524750] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159662e6-8d8b-459e-af18-9590760ed457 in Status: SUCCESS [ 1112.524928] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159662e6-8d8b-459e-af18-9590760ed457 deletion is rescheduled due to dependency. [ 1112.525050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159662e6-8d8b-459e-af18-9590760ed457" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.684684] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a8a26db-933d-48c6-81a3-eca3b8876404 [ 1112.685124] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.685375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.687439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.687736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.687874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.688021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a8a26db-933d-48c6-81a3-eca3b8876404 already deleted. [ 1112.688125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a8a26db-933d-48c6-81a3-eca3b8876404" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.520828] env[65899]: INFO networking_nsxv3.common.synchronization [req-9d119bd6-c571-4ecc-a7d0-7168b3c6fcd3 req-9664ed43-a86c-4b82-8c14-862bcca3b5ad tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1113.521427] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1113.521817] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.521881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.521919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.522165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.522320] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.522421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.522484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.522636] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.522720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.522810] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.830845] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1113.831069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.874492] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.874695] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.874821] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.875102] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.875356] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.875512] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.875625] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.875865] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.876015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.876545] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.876791] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.876958] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.877130] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.877322] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.877489] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.877667] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.897372] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.897565] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1113.897700] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.897878] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.898235] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-14c480f0-f095-48f7-8e80-d8b660809d36 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.898439] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-14c480f0-f095-48f7-8e80-d8b660809d36" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.898593] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-14c480f0-f095-48f7-8e80-d8b660809d36" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.898941] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-14c480f0-f095-48f7-8e80-d8b660809d36" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.899095] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c480f0-f095-48f7-8e80-d8b660809d36',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.025565] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.025719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.025832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.026113] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.026233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.026447] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.026585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.026708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.026835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.026969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.027017] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a73361-0065-4c2b-847b-544a63c06efc already deleted. [ 1114.027110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.402043] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.402358] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.402893] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.403306] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.403525] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.403702] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 14c480f0-f095-48f7-8e80-d8b660809d36 not found, creating... [ 1114.403991] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.404188] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.404299] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.404530] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.404661] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.404996] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.405172] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.405292] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.405490] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.405623] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.405792] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 14c480f0-f095-48f7-8e80-d8b660809d36 is going to be created. [ 1114.417671] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 in Status: SUCCESS [ 1114.417897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.418062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.418257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.418435] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.418564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.418621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.418765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.418838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.418918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.419015] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79256018-f240-48eb-94f9-bc8b0119d8f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.427727] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.427727] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.427727] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.428086] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.428086] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.428311] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-14c480f0-f095-48f7-8e80-d8b660809d36" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.921105] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-79256018-f240-48eb-94f9-bc8b0119d8f5 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.921384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.921384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.921568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.921706] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.921805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.922111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.922244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.922244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.922361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.922741] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-79256018-f240-48eb-94f9-bc8b0119d8f5 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.922741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.922741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.922741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.922921] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.922921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.922998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.923545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.923545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.923545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.923545] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79256018-f240-48eb-94f9-bc8b0119d8f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.194761] env[65899]: INFO networking_nsxv3.common.synchronization [req-9d119bd6-c571-4ecc-a7d0-7168b3c6fcd3 req-7bc4753a-b656-4f77-ab7e-1cf56259f6bb service nova] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_rules [ 1115.194928] env[65899]: INFO networking_nsxv3.common.synchronization [req-9d119bd6-c571-4ecc-a7d0-7168b3c6fcd3 req-7bc4753a-b656-4f77-ab7e-1cf56259f6bb service nova] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1115.195079] env[65899]: INFO networking_nsxv3.common.synchronization [req-9d119bd6-c571-4ecc-a7d0-7168b3c6fcd3 req-7bc4753a-b656-4f77-ab7e-1cf56259f6bb service nova] Enqueued Resource ID: 14c480f0-f095-48f7-8e80-d8b660809d36 with Priority: HIGHEST for action port [ 1115.195605] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_rules [ 1115.195605] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1115.195605] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c480f0-f095-48f7-8e80-d8b660809d36 with Priority: HIGHEST for action port [ 1115.196450] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.196577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.196645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.196845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.196921] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.198139] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.198139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.198139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.198139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.198299] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.198299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.199094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.199094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.199094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.199094] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.200503] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-14c480f0-f095-48f7-8e80-d8b660809d36 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.201646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14c480f0-f095-48f7-8e80-d8b660809d36" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.201646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14c480f0-f095-48f7-8e80-d8b660809d36" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.201646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14c480f0-f095-48f7-8e80-d8b660809d36" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.201646] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c480f0-f095-48f7-8e80-d8b660809d36',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.426140] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79256018-f240-48eb-94f9-bc8b0119d8f5: rpc.has_security_group_logging(os_id): False [ 1115.447028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.447246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.447246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.447497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.447599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.447811] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.447811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.447811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.448314] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.448314] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.448381] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.448452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.448504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.448628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.448696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.448876] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.449008] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.449278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.449474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.449584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.449792] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 is going to be created. [ 1115.565026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.565224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.565224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.565413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.565598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.589045] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 in Status: IN_PROGRESS for 2s [ 1115.703520] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.703745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.703872] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.706959] env[65899]: INFO networking_nsxv3.common.synchronization [None req-ba29187b-7c6b-4bfe-a6ca-bf123141fffa None None] Enqueued Resource ID: a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d with Priority: HIGHEST for action port [ 1115.707564] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14c480f0-f095-48f7-8e80-d8b660809d36 with status ACTIVE [ 1115.709158] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.709158] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.709158] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.709158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.709855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.709855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.709855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.709855] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14c480f0-f095-48f7-8e80-d8b660809d36 is going to be updated. [ 1115.716290] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d with Priority: HIGHEST for action port [ 1115.716290] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.716290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.716290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.716290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.716290] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.743702] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.743910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.743910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.744129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.744304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.744465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14c480f0-f095-48f7-8e80-d8b660809d36" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.208791] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.219701] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d [ 1116.219789] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.220257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.220257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.220257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.220406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.220802] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d already deleted. [ 1116.220802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0cc0d2c-9903-4f7c-a22e-334cfe0bfc1d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.557250] env[65899]: INFO networking_nsxv3.common.synchronization [None req-85a62480-e76e-4c1a-b368-5f4a53cf8949 tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_rules [ 1116.557422] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_rules [ 1116.557749] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.557820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.557897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.562101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.562288] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.679975] env[65899]: INFO networking_nsxv3.common.synchronization [None req-1d1c5ad7-070c-40b6-ad42-6c6b112b0d98 tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_rules [ 1116.679975] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_rules [ 1116.679975] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.679975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.712806] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.712899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.713060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.713228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.713363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.713401] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a73361-0065-4c2b-847b-544a63c06efc is going to be created. [ 1116.761495] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.761736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.761829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.762099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.762293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.775553] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: UNINITIALIZED for 2s [ 1117.085770] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.085770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.085770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.085770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.085770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.085770] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 already deleted. [ 1117.085770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.085770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.085770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.085770] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.567684] env[65899]: INFO networking_nsxv3.common.synchronization [req-2a0db8fd-30c3-43fe-b89f-58fd32c4a1dd req-571e6beb-71ef-445b-9929-7bad1d0ada3c tempest-AttachVolumeShelveTestJSON-1192841755 tempest-AttachVolumeShelveTestJSON-1192841755-project-member] Enqueued Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_members [ 1117.567684] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_members [ 1117.568075] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.568075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.568075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.570865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.570865] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.570865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.570865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.570865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.570865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.570865] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.601238] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 in Status: SUCCESS [ 1117.604227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.605227] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.605339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.605386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.605579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.605666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.605754] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 already deleted. [ 1117.605833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.940809] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.941191] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.941191] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.941852] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.941852] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.942026] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.942026] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.942437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.942437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.942556] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.942727] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.942775] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.942876] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.942986] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.943126] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.943264] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.964686] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.965040] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1117.965040] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.965040] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.965475] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-c0bf33c7-894e-4ff2-a7eb-502afeb75261 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.965475] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.965699] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.965941] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.966060] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0bf33c7-894e-4ff2-a7eb-502afeb75261',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.071748] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.071748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.071748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.071748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.071748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.072654] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.072654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.072654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.072654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.072654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.072654] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d already deleted. [ 1118.072654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.470671] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.470671] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.470671] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.470671] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.470934] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.470934] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port c0bf33c7-894e-4ff2-a7eb-502afeb75261 not found, creating... [ 1118.471203] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.471366] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.471477] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.471691] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.471838] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.472142] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.472288] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.472394] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.472601] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.472720] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.472859] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: c0bf33c7-894e-4ff2-a7eb-502afeb75261 is going to be created. [ 1118.498443] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.498751] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.498884] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.499182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.499554] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.499825] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.539292] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c7d5ab6a-ac05-45a7-bf04-a4bc4dd743ce None None] Enqueued Resource ID: 0ea48ddb-eb91-416e-890d-08e29d6f9307 with Priority: HIGHEST for action port [ 1118.539924] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ea48ddb-eb91-416e-890d-08e29d6f9307 with Priority: HIGHEST for action port [ 1118.540265] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ea48ddb-eb91-416e-890d-08e29d6f9307 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.540580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ea48ddb-eb91-416e-890d-08e29d6f9307" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.540580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ea48ddb-eb91-416e-890d-08e29d6f9307" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.540800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ea48ddb-eb91-416e-890d-08e29d6f9307" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.540885] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ea48ddb-eb91-416e-890d-08e29d6f9307',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.786299] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: SUCCESS [ 1118.792097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.792097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.792097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.792097] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.792097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.792097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.792097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.792097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.792097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.792097] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.045303] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ea48ddb-eb91-416e-890d-08e29d6f9307 [ 1119.045527] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.045655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.045742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.046059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.046152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.046311] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ea48ddb-eb91-416e-890d-08e29d6f9307 already deleted. [ 1119.046393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ea48ddb-eb91-416e-890d-08e29d6f9307" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.295493] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.311630] env[65899]: INFO networking_nsxv3.common.synchronization [req-2a0db8fd-30c3-43fe-b89f-58fd32c4a1dd req-2309ed76-4717-4c35-b8e4-0cba9db3d9e1 service nova] Enqueued Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_rules [ 1119.312163] env[65899]: INFO networking_nsxv3.common.synchronization [req-2a0db8fd-30c3-43fe-b89f-58fd32c4a1dd req-2309ed76-4717-4c35-b8e4-0cba9db3d9e1 service nova] Enqueued Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_members [ 1119.312163] env[65899]: INFO networking_nsxv3.common.synchronization [req-2a0db8fd-30c3-43fe-b89f-58fd32c4a1dd req-2309ed76-4717-4c35-b8e4-0cba9db3d9e1 service nova] Enqueued Resource ID: c0bf33c7-894e-4ff2-a7eb-502afeb75261 with Priority: HIGHEST for action port [ 1119.316553] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_rules [ 1119.316742] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_members [ 1119.316801] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0bf33c7-894e-4ff2-a7eb-502afeb75261 with Priority: HIGHEST for action port [ 1119.317138] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.317281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.317344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.317516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.317603] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.318705] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.318848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.319875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.319875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.319875] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.319875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.319875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.319875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.319875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.319875] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.321892] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0bf33c7-894e-4ff2-a7eb-502afeb75261 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.321892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.321892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.321892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.321892] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0bf33c7-894e-4ff2-a7eb-502afeb75261',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.634317] env[65899]: INFO networking_nsxv3.common.synchronization [req-a8d87cf9-889d-4992-a09e-2b89e47a3d9b req-4f586fd0-f7f9-4d39-889c-95d674e7f206 tempest-ServersNegativeTestJSON-2131427321 tempest-ServersNegativeTestJSON-2131427321-project-member] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1119.634882] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1119.635181] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.635305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.635369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.635564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.635840] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.635840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.635840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.636012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.636080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.636169] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.799202] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6a73361-0065-4c2b-847b-544a63c06efc: rpc.has_security_group_logging(os_id): False [ 1119.819176] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.819353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.819471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.819765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.819961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.820229] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.820394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.820843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.820843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.821054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.821156] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a73361-0065-4c2b-847b-544a63c06efc is going to be created. [ 1119.823844] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.823959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.824132] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.825065] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0bf33c7-894e-4ff2-a7eb-502afeb75261 with status ACTIVE [ 1119.825147] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.825277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.825342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.825508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.825627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.825886] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.825978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.826051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.826205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.826318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.827378] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.827378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.827378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.827378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.827378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.827378] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0bf33c7-894e-4ff2-a7eb-502afeb75261 is going to be updated. [ 1119.848841] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.848841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.848841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.848841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.848841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.848841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.887449] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.887591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.887681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.887890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.888100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.899395] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: IN_PROGRESS for 2s [ 1120.013025] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.013025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.013025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.013025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.013025] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.013025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.013025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.013628] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.013628] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.013628] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.013743] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.014144] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.014144] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.014144] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.014427] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.014427] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.039143] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.039285] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.039362] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.039533] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.039850] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-67fa8596-9b28-4e9a-9424-cb8af92c2f41 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.040636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-67fa8596-9b28-4e9a-9424-cb8af92c2f41" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.040636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-67fa8596-9b28-4e9a-9424-cb8af92c2f41" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.040636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-67fa8596-9b28-4e9a-9424-cb8af92c2f41" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.040636] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67fa8596-9b28-4e9a-9424-cb8af92c2f41',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.138237] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.329361] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.543787] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.544082] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.544282] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.544627] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.544799] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.544991] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 67fa8596-9b28-4e9a-9424-cb8af92c2f41 not found, creating... [ 1120.545332] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.545495] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.545649] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.545927] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.546131] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.546528] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.546733] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.546899] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.547209] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.547385] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.547533] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 67fa8596-9b28-4e9a-9424-cb8af92c2f41 is going to be created. [ 1120.576806] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.577226] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.577430] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.577812] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.578078] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.578316] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-67fa8596-9b28-4e9a-9424-cb8af92c2f41" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.642069] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.831188] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.831982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.831982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.831982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.831982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.831982] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d is going to be created. [ 1120.870618] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.870618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.870758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.871075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.871405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.888874] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: UNINITIALIZED for 2s [ 1121.144207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.144560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.144668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.144902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.145039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.145163] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be updated. [ 1121.174358] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.174580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.174580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.174810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.174996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.188975] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1121.299503] env[65899]: INFO networking_nsxv3.common.synchronization [req-a8d87cf9-889d-4992-a09e-2b89e47a3d9b req-fcf219aa-5ae4-461a-8eae-9d37ca0f415e service nova] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_rules [ 1121.299775] env[65899]: INFO networking_nsxv3.common.synchronization [req-a8d87cf9-889d-4992-a09e-2b89e47a3d9b req-fcf219aa-5ae4-461a-8eae-9d37ca0f415e service nova] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1121.299966] env[65899]: INFO networking_nsxv3.common.synchronization [req-a8d87cf9-889d-4992-a09e-2b89e47a3d9b req-fcf219aa-5ae4-461a-8eae-9d37ca0f415e service nova] Enqueued Resource ID: 67fa8596-9b28-4e9a-9424-cb8af92c2f41 with Priority: HIGHEST for action port [ 1121.300844] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_rules [ 1121.300844] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1121.301018] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67fa8596-9b28-4e9a-9424-cb8af92c2f41 with Priority: HIGHEST for action port [ 1121.301346] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.301509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.301594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.301807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.301915] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.302855] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.302980] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.303222] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-67fa8596-9b28-4e9a-9424-cb8af92c2f41 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.303370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67fa8596-9b28-4e9a-9424-cb8af92c2f41" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.303459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67fa8596-9b28-4e9a-9424-cb8af92c2f41" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.303645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67fa8596-9b28-4e9a-9424-cb8af92c2f41" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.303799] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67fa8596-9b28-4e9a-9424-cb8af92c2f41',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.806768] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.806891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.807111] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67fa8596-9b28-4e9a-9424-cb8af92c2f41 with status ACTIVE [ 1121.807321] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.807321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.807480] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.807556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.807692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.808448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.808448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.808448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.808448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.808448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.808448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.808448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.808967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.808967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.808967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.808967] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67fa8596-9b28-4e9a-9424-cb8af92c2f41 is going to be updated. [ 1121.836682] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.836682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.836682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.836682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.836682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.836682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67fa8596-9b28-4e9a-9424-cb8af92c2f41" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.924101] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: SUCCESS [ 1121.924374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.301104] env[65899]: INFO networking_nsxv3.common.synchronization [req-d97874b5-f35a-48d0-866d-90d5a8a88c24 req-31303a0f-8e7e-42d8-9ee1-f1c979826c02 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1122.301663] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1122.301972] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.302111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.302169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.302456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.302628] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.302746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.302818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.302998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.303273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.303372] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.646573] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.646791] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-556" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.646910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-556" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.647587] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-556" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.647897] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.648077] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.648198] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.648445] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.648672] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.648893] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.649020] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.649162] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.649279] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.649380] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.649486] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.649612] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.669036] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.669211] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.669802] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.669802] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-556" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.669802] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-4f45176c-7634-4d8a-abd0-69a29018cc4b taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.670101] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.670101] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.670416] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.670553] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f45176c-7634-4d8a-abd0-69a29018cc4b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.807426] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.807426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.807426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.807426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.807698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.807698] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.807782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.807820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.807946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.808051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.808112] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 already deleted. [ 1122.808192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.898644] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: SUCCESS [ 1122.899066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.899066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.899269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.899572] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.899707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.899783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.899944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.900032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.900116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.900202] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.173190] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.173486] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.174631] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.174631] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.174631] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.174867] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 4f45176c-7634-4d8a-abd0-69a29018cc4b not found, creating... [ 1123.175459] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.175858] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.176024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.176483] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.176738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.177405] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.177693] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.177920] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.178416] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.178700] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.179172] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b is going to be created. [ 1123.201366] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1123.201644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.201753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.202112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.202276] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.202395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.202487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.202628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.202695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.202789] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.227873] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.227973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.228040] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.228362] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.228841] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.229033] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.403614] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.708114] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.905872] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08b51b44-1df0-4a96-9da8-8c013955ee0d: rpc.has_security_group_logging(os_id): False [ 1123.928077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.928077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.928077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.928077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.928077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.928077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.928077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.928077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.928077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.928077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.928077] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d is going to be created. [ 1123.932208] env[65899]: INFO networking_nsxv3.common.synchronization [req-d97874b5-f35a-48d0-866d-90d5a8a88c24 req-74407dcf-1c4f-4793-b3af-49eff0aa5ab8 service nova] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1123.932602] env[65899]: INFO networking_nsxv3.common.synchronization [req-d97874b5-f35a-48d0-866d-90d5a8a88c24 req-74407dcf-1c4f-4793-b3af-49eff0aa5ab8 service nova] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1123.932777] env[65899]: INFO networking_nsxv3.common.synchronization [req-d97874b5-f35a-48d0-866d-90d5a8a88c24 req-74407dcf-1c4f-4793-b3af-49eff0aa5ab8 service nova] Enqueued Resource ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b with Priority: HIGHEST for action port [ 1123.933427] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1123.933558] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1123.933646] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b with Priority: HIGHEST for action port [ 1123.934126] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.934245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.934340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.934539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.934619] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.936500] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.936500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.936500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.936500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.936500] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.936500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.936949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.936949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.936949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.936949] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.937825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f45176c-7634-4d8a-abd0-69a29018cc4b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.937936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.938013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.938421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.938421] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f45176c-7634-4d8a-abd0-69a29018cc4b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.998206] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.998382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.998457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.998721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.998930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.013142] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: IN_PROGRESS for 2s [ 1124.210416] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.444237] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f45176c-7634-4d8a-abd0-69a29018cc4b with status ACTIVE [ 1124.444237] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.444460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.444460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.444623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.444665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.444833] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.444933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.444989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.445408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.445509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.445943] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.445943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.445943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.445943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.446809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.446809] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b is going to be updated. [ 1124.449326] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.449326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.449326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.473092] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.473092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.473452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.473527] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.473950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.473950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.560566] env[65899]: INFO networking_nsxv3.common.synchronization [req-df1e23c1-f80e-4348-9c1f-bf64ccc2374d req-a51803a3-49ec-44a1-8ac0-fc21ee34d903 tempest-ServerTagsTestJSON-540486860 tempest-ServerTagsTestJSON-540486860-project-member] Enqueued Resource ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 with Priority: HIGHEST for action security_group_members [ 1124.560793] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 with Priority: HIGHEST for action security_group_members [ 1124.561166] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-79256018-f240-48eb-94f9-bc8b0119d8f5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.561317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.561374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.561675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.561771] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.561917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.561917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.562982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.562982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.562982] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79256018-f240-48eb-94f9-bc8b0119d8f5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.714481] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.714661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.714733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.714966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.715069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.715182] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be updated. [ 1124.751637] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.751904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.751904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.752044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.752190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.765445] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1124.952608] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.953664] env[65899]: INFO networking_nsxv3.common.synchronization [req-410d52ae-9d7d-4372-a762-4b09df3c6c08 req-2386f575-23c6-413d-a92b-96f866af579b tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1124.954377] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1124.954791] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.954791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.954791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.955043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.955098] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.955895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.955895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.955895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.955895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.955895] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.066221] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.066425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.066495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.066739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.066853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.067069] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.067165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.067224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.067402] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.067480] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.067570] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 is going to be updated. [ 1125.098149] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.098330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.098375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.098596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.098761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.110719] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 in Status: IN_PROGRESS for 2s [ 1125.454632] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.454860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.454924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.455208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.455318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.455440] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be created. [ 1125.461361] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.461572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.461645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.462055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.462055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.462291] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.462467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.462525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.462714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.462812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.462950] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1125.488356] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.488556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.488689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.489567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.489567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.491631] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.491829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.491867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.492111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.492555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.497591] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.497788] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.497900] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.498167] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.498440] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.498568] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.498681] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.498891] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.499201] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.499284] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.499628] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.499788] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.499904] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.500034] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.500148] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.500280] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.503690] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: UNINITIALIZED for 2s [ 1125.504398] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1125.525769] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.525955] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1125.526090] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.526264] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.526664] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.526820] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.526944] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.527215] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.527375] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f5ebf6-f5f9-415c-9f93-b55de5c20188',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.026201] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: SUCCESS [ 1126.026611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.030290] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.030516] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.030662] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.030947] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.031143] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.031320] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port d3f5ebf6-f5f9-415c-9f93-b55de5c20188 not found, creating... [ 1126.031666] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.031892] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.031990] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.032247] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.036098] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.036098] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.036098] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.036098] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.036098] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.036098] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.036098] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: d3f5ebf6-f5f9-415c-9f93-b55de5c20188 is going to be created. [ 1126.057488] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.057785] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.057913] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.058250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.058488] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.058721] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.779025] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1126.779025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.779201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.779413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.779650] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.779764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.779764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.780271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.780271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.780271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.780271] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.835666] env[65899]: INFO networking_nsxv3.common.synchronization [req-410d52ae-9d7d-4372-a762-4b09df3c6c08 req-d5e59073-cd98-4093-acba-b379a47efe43 service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 1126.835946] env[65899]: INFO networking_nsxv3.common.synchronization [req-410d52ae-9d7d-4372-a762-4b09df3c6c08 req-d5e59073-cd98-4093-acba-b379a47efe43 service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1126.836121] env[65899]: INFO networking_nsxv3.common.synchronization [req-410d52ae-9d7d-4372-a762-4b09df3c6c08 req-d5e59073-cd98-4093-acba-b379a47efe43 service nova] Enqueued Resource ID: d3f5ebf6-f5f9-415c-9f93-b55de5c20188 with Priority: HIGHEST for action port [ 1126.837917] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 1126.838067] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1126.838163] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5ebf6-f5f9-415c-9f93-b55de5c20188 with Priority: HIGHEST for action port [ 1126.838460] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.839842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.839842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.839842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.839842] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.840433] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.840433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.840586] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.840586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.840736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.840956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.841043] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f5ebf6-f5f9-415c-9f93-b55de5c20188',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.130332] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 in Status: SUCCESS [ 1127.130794] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79256018-f240-48eb-94f9-bc8b0119d8f5 deletion is rescheduled due to dependency. [ 1127.130932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79256018-f240-48eb-94f9-bc8b0119d8f5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.287075] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.287742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.287742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.287906] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.288168] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.288286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.288351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.288519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.288606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.288698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.288862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.288957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.289025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.289168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.289325] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.289416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.289474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.289606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.289680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.289758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.289842] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.343036] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.343171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.343293] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3f5ebf6-f5f9-415c-9f93-b55de5c20188 with status ACTIVE [ 1127.343461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.343558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.343644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.344334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.344334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.344334] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.344334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.344334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.344688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.344688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.344859] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.344859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.344859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.345081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.345081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.345161] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3f5ebf6-f5f9-415c-9f93-b55de5c20188 is going to be updated. [ 1127.375289] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.375432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.375499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.375715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.375847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.375998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3f5ebf6-f5f9-415c-9f93-b55de5c20188" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.518817] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1127.519076] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b deletion is rescheduled due to dependency. [ 1127.519188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.520105] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1127.520352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.520729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.520969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.521182] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.521306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.521357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.521516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.521651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.521801] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.522747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.522887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.523351] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.523351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.523351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.523351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.523543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.523543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.523929] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.792250] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd672f3d-6117-44aa-8b2f-40dde93f9373: rpc.has_security_group_logging(os_id): False [ 1127.810981] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.811173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.811219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.811430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.811661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.811789] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.811861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.811901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.812594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.812594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.812594] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.812594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.812594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.812594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.812962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.812962] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.812962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.812962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.814150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.814150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.814371] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be updated. [ 1127.888725] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.889029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.889029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.889351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.889586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.912022] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1128.025581] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.027425] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.027425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.027425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.027851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.027937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.028151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.028370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.028721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.028921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.029128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.029556] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.029556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.029708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.029868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.030131] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.030325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.030405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.030711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.030864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.030995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.031307] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.533843] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.534894] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10e0d2a4-e42f-49c4-b693-268f72e54b08: rpc.has_security_group_logging(os_id): False [ 1128.555198] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.555198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.555464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.555464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.555575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.555752] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.555865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.555926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.556164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.556164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.556299] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.556668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.556668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.556668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.556866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.556866] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.556964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.556999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.557351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.557351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.557351] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be created. [ 1128.626978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.628946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.628946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.628946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.628946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.638674] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1129.037732] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.038089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.038218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.038514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.038660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.038857] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1129.076028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.076028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.076028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.076028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.076028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.087825] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1129.932304] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1129.932599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.287373] env[65899]: INFO networking_nsxv3.common.synchronization [req-d2dfa17f-a89b-46ef-818c-26427897ea33 req-aacbd7fa-3521-455f-8814-55b0deec5567 tempest-ServersTestBootFromVolume-2100478652 tempest-ServersTestBootFromVolume-2100478652-project-member] Enqueued Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_members [ 1130.287968] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_members [ 1130.288713] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c86f328f-f619-4559-ae86-8793a284cfe3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.288910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.288910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.289193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.289356] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.289457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.289516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.289671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.289772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.289843] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.653788] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.653788] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-781" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.654087] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-781" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.654401] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-781" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.654751] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.654907] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.655078] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.655633] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.655633] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.655810] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.655981] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.656180] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.656322] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.656636] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.656701] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.656797] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.659831] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1130.659831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.680033] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.680033] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.680033] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.680321] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-781" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.680509] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.680683] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.680804] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.681149] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.681290] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d2e67d7-742f-4f74-8ec4-6660f2fae5cb',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.791568] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.791835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.791835] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.792144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.792199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.792408] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.792539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.792607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.792804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.792891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.793026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c86f328f-f619-4559-ae86-8793a284cfe3 already deleted. [ 1130.793077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.098718] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1131.098911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.099020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.099205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.099430] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.099649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.099716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.099873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.099954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.100058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.100198] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.183936] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.184258] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.184456] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.184766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.185149] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.185149] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 7d2e67d7-742f-4f74-8ec4-6660f2fae5cb not found, creating... [ 1131.185478] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.185715] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.185715] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.185969] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.186147] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.186514] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.186684] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.186806] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.187051] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.187676] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.187676] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 7d2e67d7-742f-4f74-8ec4-6660f2fae5cb is going to be created. [ 1131.210376] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.210597] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.210752] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.211088] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.211332] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.211563] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.357831] env[65899]: INFO networking_nsxv3.common.synchronization [req-602dfad1-6b68-491a-a5f1-977d396f9688 req-a4728536-3cac-4fdc-a923-40851be2d5ec tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_members [ 1131.358860] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGHEST for action security_group_members [ 1131.359545] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8701ee7-7415-4cf0-b1a2-be123eab71e4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.360196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.360196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.360324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.360522] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.360713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.360851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.361289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.361289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.361464] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.603337] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.603337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.603337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.603611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.603755] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.603944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.604080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.605086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.605086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.605086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.605086] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.605086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.605447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.605447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.605654] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.606176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.606176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.606580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.607971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.607971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.608085] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.863798] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.863896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.863896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.864151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.864251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.864489] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.864651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.864651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.865063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.865063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.865175] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 is going to be updated. [ 1131.896573] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.896786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.896843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.897114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.897218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.906977] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 in Status: IN_PROGRESS for 2s [ 1131.972448] env[65899]: INFO networking_nsxv3.common.synchronization [req-d2dfa17f-a89b-46ef-818c-26427897ea33 req-d63060dd-a30c-4e53-a059-9c44f56a81ff service nova] Enqueued Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_rules [ 1131.972448] env[65899]: INFO networking_nsxv3.common.synchronization [req-d2dfa17f-a89b-46ef-818c-26427897ea33 req-d63060dd-a30c-4e53-a059-9c44f56a81ff service nova] Enqueued Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_members [ 1131.972448] env[65899]: INFO networking_nsxv3.common.synchronization [req-d2dfa17f-a89b-46ef-818c-26427897ea33 req-d63060dd-a30c-4e53-a059-9c44f56a81ff service nova] Enqueued Resource ID: 7d2e67d7-742f-4f74-8ec4-6660f2fae5cb with Priority: HIGHEST for action port [ 1131.974265] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_rules [ 1131.974387] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_members [ 1131.979326] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d2e67d7-742f-4f74-8ec4-6660f2fae5cb with Priority: HIGHEST for action port [ 1131.979326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c86f328f-f619-4559-ae86-8793a284cfe3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.979326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.979326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.979326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.979326] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.979326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c86f328f-f619-4559-ae86-8793a284cfe3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.979742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.979742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.979841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.980091] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.980091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.980226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.980270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.980344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.980453] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.981908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.982151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.982151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.982324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.982403] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d2e67d7-742f-4f74-8ec4-6660f2fae5cb',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.113286] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b: rpc.has_security_group_logging(os_id): False [ 1132.134052] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.134052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.134052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.134368] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.134368] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.134544] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.134705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.134795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.135042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.135135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.135479] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.135577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.135636] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.135791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.135884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.137116] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.137116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.137116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.137116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.137996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.137996] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1132.217480] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.217662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.217735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.217967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.218124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.243062] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1132.412988] env[65899]: INFO networking_nsxv3.common.synchronization [req-952d0694-3741-4fc6-9aa1-bbfc769792ba req-8053d84b-ab88-41f1-8771-0f35017b3603 tempest-ServersNegativeTestJSON-2131427321 tempest-ServersNegativeTestJSON-2131427321-project-member] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1132.413549] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1132.413872] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.413969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.414068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.414559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.414729] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.414826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.414887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.415058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.415197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.415239] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.484895] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c86f328f-f619-4559-ae86-8793a284cfe3 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.485117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.485249] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.488427] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d2e67d7-742f-4f74-8ec4-6660f2fae5cb with status ACTIVE [ 1132.488427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.488427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.488427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.488427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.488427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.488427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.488427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.488427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.488854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.488854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.488854] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.488963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.491052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.491052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.491052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.491052] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d2e67d7-742f-4f74-8ec4-6660f2fae5cb is going to be updated. [ 1132.514078] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.514244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.514317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.514555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.514767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.515063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d2e67d7-742f-4f74-8ec4-6660f2fae5cb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.917281] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.988061] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.419644] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.490921] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.491501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.491749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.492704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.492805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.492923] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c86f328f-f619-4559-ae86-8793a284cfe3 is going to be created. [ 1133.525915] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.526058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.526134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.526329] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.526553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.538375] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c86f328f-f619-4559-ae86-8793a284cfe3 in Status: UNINITIALIZED for 2s [ 1133.924042] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.924042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.924042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.924042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.924042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.924042] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be updated. [ 1133.926688] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 in Status: SUCCESS [ 1133.926845] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 deletion is rescheduled due to dependency. [ 1133.926950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.959139] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.959139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.959139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.959139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.959139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.979627] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1134.265227] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1134.265400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.552695] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c86f328f-f619-4559-ae86-8793a284cfe3 in Status: SUCCESS [ 1135.552695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.552695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.552695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.552695] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.552695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.552695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.552695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.552695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.552695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.552695] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.737533] env[65899]: INFO networking_nsxv3.common.synchronization [None req-b0db3ef7-9f48-478e-ae31-97d9e687bd5c None None] Enqueued Resource ID: 951fa5c5-b967-4c5b-a286-c8c8b98631d7 with Priority: HIGHEST for action port [ 1135.737533] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 951fa5c5-b967-4c5b-a286-c8c8b98631d7 with Priority: HIGHEST for action port [ 1135.737533] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-951fa5c5-b967-4c5b-a286-c8c8b98631d7 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.737533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-951fa5c5-b967-4c5b-a286-c8c8b98631d7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.737533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-951fa5c5-b967-4c5b-a286-c8c8b98631d7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.738166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-951fa5c5-b967-4c5b-a286-c8c8b98631d7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.738698] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('951fa5c5-b967-4c5b-a286-c8c8b98631d7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.991626] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1135.991626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.056697] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.243223] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 951fa5c5-b967-4c5b-a286-c8c8b98631d7 [ 1136.243460] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.243686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.243686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.243871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.243957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.244064] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:951fa5c5-b967-4c5b-a286-c8c8b98631d7 already deleted. [ 1136.244143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-951fa5c5-b967-4c5b-a286-c8c8b98631d7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.304098] env[65899]: INFO networking_nsxv3.common.synchronization [req-49c4efa1-f561-4091-a8f8-93e1ad43cfbc req-de6697b4-a072-42fa-ac62-a4d0973f7e6f tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1136.304224] env[65899]: INFO networking_nsxv3.common.synchronization [req-49c4efa1-f561-4091-a8f8-93e1ad43cfbc req-de6697b4-a072-42fa-ac62-a4d0973f7e6f tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1136.304990] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1136.307218] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1136.307218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.307218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.307218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.307218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.307218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.307218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.307218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.307218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.307218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.307218] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.310196] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.310196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.310196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.310196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.310196] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.310196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.310196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.311997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.312114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.312212] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.355410] env[65899]: INFO networking_nsxv3.common.synchronization [req-49c4efa1-f561-4091-a8f8-93e1ad43cfbc req-de6697b4-a072-42fa-ac62-a4d0973f7e6f tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1136.356391] env[65899]: INFO networking_nsxv3.common.synchronization [req-49c4efa1-f561-4091-a8f8-93e1ad43cfbc req-de6697b4-a072-42fa-ac62-a4d0973f7e6f tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1136.356391] env[65899]: INFO networking_nsxv3.common.synchronization [req-49c4efa1-f561-4091-a8f8-93e1ad43cfbc req-de6697b4-a072-42fa-ac62-a4d0973f7e6f tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_rules [ 1136.356391] env[65899]: INFO networking_nsxv3.common.synchronization [req-49c4efa1-f561-4091-a8f8-93e1ad43cfbc req-de6697b4-a072-42fa-ac62-a4d0973f7e6f tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1136.356391] env[65899]: INFO networking_nsxv3.common.synchronization [req-49c4efa1-f561-4091-a8f8-93e1ad43cfbc req-de6697b4-a072-42fa-ac62-a4d0973f7e6f tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b with Priority: HIGHEST for action port [ 1136.356631] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1136.356631] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_rules [ 1136.356717] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b with Priority: HIGHEST for action port [ 1136.356789] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1136.356873] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1136.357161] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.357280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.357347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.357654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.357747] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.358620] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.358836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.358964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.359228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.359311] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.361696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f45176c-7634-4d8a-abd0-69a29018cc4b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.361696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.361696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.361696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.362596] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f45176c-7634-4d8a-abd0-69a29018cc4b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.362701] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.362836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.362969] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.363052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.561296] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c86f328f-f619-4559-ae86-8793a284cfe3: rpc.has_security_group_logging(os_id): False [ 1136.582756] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.582756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.582756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.583260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.583393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.583933] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.583933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.583933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.584102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.584153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.584224] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c86f328f-f619-4559-ae86-8793a284cfe3 is going to be created. [ 1136.656395] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.656692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.656692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.656831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.657018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.672033] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c86f328f-f619-4559-ae86-8793a284cfe3 in Status: IN_PROGRESS for 2s [ 1136.815898] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.815898] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.865469] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.865469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.865469] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.865469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.865469] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f45176c-7634-4d8a-abd0-69a29018cc4b with status ACTIVE [ 1136.865469] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.865469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.865469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.865469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.866130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.866130] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.866130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.866130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.867515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.867515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.868046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.868215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.868322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.868530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.868661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.869145] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b is going to be updated. [ 1136.894063] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.894063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.894063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.894063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.894063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.894063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.316494] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.318525] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.368575] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1137.368826] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGHEST for action security_group_members [ 1137.369264] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1137.369669] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1137.369801] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGHEST for action security_group_members [ 1137.369894] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1137.374453] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.374453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.374453] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ac6b18-4924-425a-a674-ac5343806fa2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.374453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.374453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.374798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.374798] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.374798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.374925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.375033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.375106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.375205] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.376216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.376216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.437021] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1137.437021] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1137.437021] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_rules [ 1137.437021] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1137.437021] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGHEST for action security_group_rules [ 1137.437021] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGHEST for action security_group_members [ 1137.437629] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e0993e2-2a22-4740-8798-528fb88b9179 req-195020cb-0b2b-4882-a985-a1c7867a8051 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b with Priority: HIGHEST for action port [ 1137.438814] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1137.439187] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_rules [ 1137.439436] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGHEST for action security_group_members [ 1137.439719] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b with Priority: HIGHEST for action port [ 1137.441072] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGHEST for action security_group_rules [ 1137.441072] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1137.441072] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1137.441072] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.441072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.441072] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.441072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.441791] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ac6b18-4924-425a-a674-ac5343806fa2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.441791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.441964] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f45176c-7634-4d8a-abd0-69a29018cc4b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.442117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.442117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.443435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.443435] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f45176c-7634-4d8a-abd0-69a29018cc4b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.443435] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94ac6b18-4924-425a-a674-ac5343806fa2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.443435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.443435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.443810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.443810] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.444592] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.444695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.444858] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.445513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.819289] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.819732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.819732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.819872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.819872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.819995] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1137.821766] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.821766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.821766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.821766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.822118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.822118] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be created. [ 1137.863114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.863359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.863433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.863673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.863882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.875777] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.875950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.876102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.876302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.876563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.878050] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.879929] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1137.892617] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: UNINITIALIZED for 2s [ 1137.946221] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ac6b18-4924-425a-a674-ac5343806fa2 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.946367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.946692] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f45176c-7634-4d8a-abd0-69a29018cc4b with status ACTIVE [ 1137.946891] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.947014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.947079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.947325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.947408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.947645] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.947766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.947821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.947955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.948057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.948237] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.948332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.948383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.948572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.948661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.948661] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f45176c-7634-4d8a-abd0-69a29018cc4b is going to be updated. [ 1137.978897] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.979598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.979598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.979844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.979975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.980204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f45176c-7634-4d8a-abd0-69a29018cc4b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.298024] env[65899]: INFO networking_nsxv3.common.synchronization [None req-f72fe618-3b7d-47ea-84c3-aad624936588 None None] Enqueued Resource ID: fb9f6dc6-098e-407c-8951-e85cfefc64eb with Priority: HIGHEST for action port [ 1138.298024] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb9f6dc6-098e-407c-8951-e85cfefc64eb with Priority: HIGHEST for action port [ 1138.298024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb9f6dc6-098e-407c-8951-e85cfefc64eb taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.298024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb9f6dc6-098e-407c-8951-e85cfefc64eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.298024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb9f6dc6-098e-407c-8951-e85cfefc64eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.298024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb9f6dc6-098e-407c-8951-e85cfefc64eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.298024] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb9f6dc6-098e-407c-8951-e85cfefc64eb',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.387892] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.686096] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c86f328f-f619-4559-ae86-8793a284cfe3 in Status: SUCCESS [ 1138.686316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.800944] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb9f6dc6-098e-407c-8951-e85cfefc64eb [ 1138.801321] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.801461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.801537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.801890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.801890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.801985] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb9f6dc6-098e-407c-8951-e85cfefc64eb already deleted. [ 1138.802047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb9f6dc6-098e-407c-8951-e85cfefc64eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.893610] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.893924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.893924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.894305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.894305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.894305] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ac6b18-4924-425a-a674-ac5343806fa2 is going to be created. [ 1138.924787] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.924922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.924922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.925130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.925295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.942546] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: UNINITIALIZED for 2s [ 1139.868230] env[65899]: INFO networking_nsxv3.common.synchronization [req-7b3c59c0-c022-428a-baa7-4f25dbc31ce3 req-11f29b89-5369-4f2f-902b-52bb3e5de76f tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1139.870378] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1139.875404] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.875404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.875404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.875404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.875404] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.875404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.875404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.875404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.875404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.875404] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.892979] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1139.892979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.894143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.894407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.894597] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.894771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.894869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.895150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.895272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.895430] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.904689] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: SUCCESS [ 1139.904822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.905887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.906140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.906330] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.906605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.906753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.907025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.907161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.907315] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.310401] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-234 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.310401] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-234" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.310401] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-234" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.314117] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-234" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.314117] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.314117] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.314117] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.314117] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.314117] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.314652] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.314652] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.314652] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.314652] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.314860] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.314860] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.314965] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.341195] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.341500] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.341500] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.341692] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-234" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.342064] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-da8a0633-832c-4253-8d78-3c1b68f686b9 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.342273] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.342399] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.342834] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.342987] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8a0633-832c-4253-8d78-3c1b68f686b9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.376340] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.376987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.377075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.377308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.377414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.377661] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.377788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.377871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.377986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.378094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.378169] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa already deleted. [ 1140.378284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.397914] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.409314] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.845937] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.846174] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.846310] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.846610] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.846750] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.846895] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port da8a0633-832c-4253-8d78-3c1b68f686b9 not found, creating... [ 1140.847171] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.847479] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.847479] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.847670] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.848373] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.848373] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.848373] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.848373] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.848668] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.848668] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.848855] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: da8a0633-832c-4253-8d78-3c1b68f686b9 is going to be created. [ 1140.870071] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.870298] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.870422] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.870795] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.870938] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.871132] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.902212] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.913252] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.958846] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: SUCCESS [ 1140.959157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.959340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.959558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.959786] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.959950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.959950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.960115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.960193] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.960290] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.186770] env[65899]: INFO networking_nsxv3.common.synchronization [req-9d146e23-d3ab-40e8-9c92-b5f14d09f913 req-94fb6a68-e646-418f-b392-cce6980ea222 tempest-ServersAdminTestJSON-2084545516 tempest-ServersAdminTestJSON-2084545516-project-member] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1141.187763] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1141.187763] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.187763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.188072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.188072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.188392] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.188392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.188392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.188556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.188591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.188665] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.404491] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.404650] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.404805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.404942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.405057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.405146] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1141.416073] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.416226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.416297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.416522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.416617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.416714] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be updated. [ 1141.434745] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.434895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.434965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.435185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.435333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.444435] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1141.445462] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.445595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.445660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.445847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.445983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.453399] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: IN_PROGRESS for 2s [ 1141.464189] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.563591] env[65899]: INFO networking_nsxv3.common.synchronization [req-7b3c59c0-c022-428a-baa7-4f25dbc31ce3 req-b858643a-addc-4947-98c4-ff1c6f0257ad service nova] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_rules [ 1141.563591] env[65899]: INFO networking_nsxv3.common.synchronization [req-7b3c59c0-c022-428a-baa7-4f25dbc31ce3 req-b858643a-addc-4947-98c4-ff1c6f0257ad service nova] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1141.563591] env[65899]: INFO networking_nsxv3.common.synchronization [req-7b3c59c0-c022-428a-baa7-4f25dbc31ce3 req-b858643a-addc-4947-98c4-ff1c6f0257ad service nova] Enqueued Resource ID: da8a0633-832c-4253-8d78-3c1b68f686b9 with Priority: HIGHEST for action port [ 1141.563591] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_rules [ 1141.563591] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1141.563591] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da8a0633-832c-4253-8d78-3c1b68f686b9 with Priority: HIGHEST for action port [ 1141.563591] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.563591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.563591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.563591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.563591] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.564360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.564476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.564542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.564714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.564875] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.564983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.565035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.565181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.565264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.565350] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.566110] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-da8a0633-832c-4253-8d78-3c1b68f686b9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.566218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.566273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.566424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.566516] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8a0633-832c-4253-8d78-3c1b68f686b9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.690328] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.967589] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.070624] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.070768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.071225] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.072406] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da8a0633-832c-4253-8d78-3c1b68f686b9 with status ACTIVE [ 1142.072517] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.072725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.072725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.072963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.072963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.073127] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.073211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.073267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.073938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.073938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.074230] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.074322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.074659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.074659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.074992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.074992] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da8a0633-832c-4253-8d78-3c1b68f686b9 is going to be updated. [ 1142.098294] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.098449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.098519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.098728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.098859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.099027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.194875] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.470555] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.470715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.470785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.470999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.471200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.471200] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ac6b18-4924-425a-a674-ac5343806fa2 is going to be updated. [ 1142.507479] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.507479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.507683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.507905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.508080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.518271] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: IN_PROGRESS for 2s [ 1142.577998] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.697880] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.697880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.697880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.697880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.697880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.698242] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1142.724832] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.725234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.725234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.725486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.725639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.734882] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1143.079864] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.079864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.080426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.080426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.080426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.080547] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be created. [ 1143.118589] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.119175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.119272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.119488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.119653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.129839] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: UNINITIALIZED for 2s [ 1143.455208] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1143.455208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.458084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.458084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.458084] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.458084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.458084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.458084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.458084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.458084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.458084] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.458084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.458734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.458734] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.458734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.458734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.458734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.458734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.458734] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.469699] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: SUCCESS [ 1143.469913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.470096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.470306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.470492] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.470597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.470656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.470871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.470871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.471000] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.471161] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.475365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.475570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.475742] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.475853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.475913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.476079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.476166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.476295] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.706141] env[65899]: INFO networking_nsxv3.common.synchronization [None req-285b464b-f398-45b3-adb5-d643b3023464 None None] Enqueued Resource ID: 23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3 with Priority: HIGHEST for action port [ 1143.706409] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3 with Priority: HIGHEST for action port [ 1143.706995] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.707149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.707212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.707417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.707534] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.961826] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.962014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.962328] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.977575] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.978512] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.212100] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3 [ 1144.212500] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.212593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.212593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.212928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.213848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.213962] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3 already deleted. [ 1144.214071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23bb51dc-4ee1-4c0c-b3aa-7712fadeb7c3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.464480] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.481029] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47f32cb1-135b-4397-8ab9-34d019c13eaf: rpc.has_security_group_logging(os_id): False [ 1144.482292] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.500575] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.501108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.501108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.501108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.501108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.501387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.501387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.501387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.501539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.504207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.504207] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be created. [ 1144.529726] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: SUCCESS [ 1144.529950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.530135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.530351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.530993] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.530993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.530993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.530993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.530993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.530993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.531356] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.563133] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.563288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.563342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.563542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.563722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.577849] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: IN_PROGRESS for 2s [ 1144.746833] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1144.747170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.966595] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.966763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.966843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.967060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.967161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.967255] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1144.985566] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.985566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.986015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.986015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.986015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.986309] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be updated. [ 1144.998173] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.998470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.998470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.998684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.998826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.007536] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1145.019077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.019282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.019282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.019497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.019648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.028586] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: IN_PROGRESS for 2s [ 1145.032982] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.144302] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1145.144514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.144703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.144916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.146114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.146988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.146988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.146988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.146988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.146988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.146988] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.536084] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94ac6b18-4924-425a-a674-ac5343806fa2: rpc.has_security_group_logging(os_id): False [ 1145.554862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.555093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.555093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.555271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.555343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.555576] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.555691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.555763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.555926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.555986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.556090] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94ac6b18-4924-425a-a674-ac5343806fa2 is going to be created. [ 1145.615962] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.616291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.616291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.616461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.617055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.638199] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: IN_PROGRESS for 2s [ 1145.648618] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.648827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.648827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.649128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.649302] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.649409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.649467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.649625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.649713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.649822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.649978] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.650082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.650137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.650276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.650412] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.650499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.650564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.650688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.650765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.650844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.650935] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.737023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.737245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.738891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.738891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.738891] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.116363] env[65899]: INFO networking_nsxv3.common.synchronization [None req-1a8081f2-1737-4279-ae56-51c95c2bc8b8 None None] Enqueued Resource ID: 3d6bf25e-84d2-4402-857c-c9bf966cbd22 with Priority: HIGHEST for action port [ 1146.116713] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d6bf25e-84d2-4402-857c-c9bf966cbd22 with Priority: HIGHEST for action port [ 1146.117027] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d6bf25e-84d2-4402-857c-c9bf966cbd22 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.117152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d6bf25e-84d2-4402-857c-c9bf966cbd22" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.117200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d6bf25e-84d2-4402-857c-c9bf966cbd22" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.117447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d6bf25e-84d2-4402-857c-c9bf966cbd22" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.117536] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d6bf25e-84d2-4402-857c-c9bf966cbd22',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.153722] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5fc4719-ed06-40a1-9606-7c4ebb5340aa: rpc.has_security_group_logging(os_id): False [ 1146.171264] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.171477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.171477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.171676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.171762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.172030] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.172154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.172214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.172366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.172439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.172623] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.172714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.172771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.172900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.172994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.173187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.173276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.173340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.173464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.173534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.173616] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be created. [ 1146.229210] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.229310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.229310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.229523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.229722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.241531] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.243174] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: IN_PROGRESS for 2s [ 1146.248264] env[65899]: INFO networking_nsxv3.common.synchronization [req-c65bb9d0-4a59-4c6a-af6b-544274800825 req-838d10c7-1954-4844-a691-05a947ffcaca tempest-ServerRescueNegativeTestJSON-46823991 tempest-ServerRescueNegativeTestJSON-46823991-project-member] Enqueued Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_members [ 1146.248911] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 with Priority: HIGHEST for action security_group_members [ 1146.249282] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a32a98c-e183-4d24-a064-a30e3d8451a7 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.249399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.249452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.249682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.249870] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.250014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.250105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.250289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.251051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.251051] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a32a98c-e183-4d24-a064-a30e3d8451a7',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.421448] env[65899]: INFO networking_nsxv3.common.synchronization [req-e7598e91-a247-4a55-b282-feb6b58e2f67 req-fb6c6eb3-b71c-4b91-9dd6-0bf6a22011a2 tempest-ServerAddressesTestJSON-480126856 tempest-ServerAddressesTestJSON-480126856-project-member] Enqueued Resource ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f with Priority: HIGHEST for action security_group_members [ 1146.421448] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f with Priority: HIGHEST for action security_group_members [ 1146.421448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.421448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.422398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.423871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.424173] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.424410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.424737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.425032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.425215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.426718] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a9aad73-83b3-40ec-b675-e69c4f59ba9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.592639] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: SUCCESS [ 1146.592934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.593051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.593270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.593375] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.620886] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d6bf25e-84d2-4402-857c-c9bf966cbd22 [ 1146.621355] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.621798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.621999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.622653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.622653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.622653] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d6bf25e-84d2-4402-857c-c9bf966cbd22 already deleted. [ 1146.622653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d6bf25e-84d2-4402-857c-c9bf966cbd22" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.747651] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.755321] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.755321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.755321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.755321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.755321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.755321] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.755321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.755321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.755321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.755321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.755321] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 is going to be updated. [ 1146.772044] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-671 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.772044] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-671" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.772044] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-671" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.772044] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-671" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.772044] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.772044] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.772044] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.772044] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.772044] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.772044] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.772044] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.774501] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.774501] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.774501] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.774501] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.774501] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.797057] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.797057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.797057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.797057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.797057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.798462] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.799267] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.799648] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.799963] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-671" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.800392] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-b6e35159-57f8-4460-af80-75a4ddc77de5 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.800844] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-b6e35159-57f8-4460-af80-75a4ddc77de5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.801150] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-b6e35159-57f8-4460-af80-75a4ddc77de5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.801604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-b6e35159-57f8-4460-af80-75a4ddc77de5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.802270] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6e35159-57f8-4460-af80-75a4ddc77de5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.811666] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 in Status: IN_PROGRESS for 2s [ 1146.929076] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.929076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.929076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.929076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.929076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.929286] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.929286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.929379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.929849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.929923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.929997] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f already deleted. [ 1146.930136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.017952] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1147.018199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.018359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.018608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.018785] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.018888] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.018936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.019243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.019243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.019362] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.043283] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: SUCCESS [ 1147.043553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.044030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.044257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.044454] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.044628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.044698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.044800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.044882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.044975] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.096219] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.096352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.249321] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1147.249321] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1147.306167] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.306462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.306653] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.306938] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.307101] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.307257] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port b6e35159-57f8-4460-af80-75a4ddc77de5 not found, creating... [ 1147.307560] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.307728] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.308182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.308182] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.308419] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.308607] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.308748] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.308876] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.309178] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.309247] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.309406] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: b6e35159-57f8-4460-af80-75a4ddc77de5 is going to be created. [ 1147.342483] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.342795] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.342972] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.343272] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.343506] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.343773] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-b6e35159-57f8-4460-af80-75a4ddc77de5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.522745] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.547198] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.654172] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: SUCCESS [ 1147.654720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.029444] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.050464] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.089419] env[65899]: INFO networking_nsxv3.common.synchronization [req-e7598e91-a247-4a55-b282-feb6b58e2f67 req-6c07e7d0-c9d8-4b11-952f-3d4e4d7140ed service nova] Enqueued Resource ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f with Priority: HIGHEST for action security_group_rules [ 1148.089537] env[65899]: INFO networking_nsxv3.common.synchronization [req-e7598e91-a247-4a55-b282-feb6b58e2f67 req-6c07e7d0-c9d8-4b11-952f-3d4e4d7140ed service nova] Enqueued Resource ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f with Priority: HIGHEST for action security_group_members [ 1148.089650] env[65899]: INFO networking_nsxv3.common.synchronization [req-e7598e91-a247-4a55-b282-feb6b58e2f67 req-6c07e7d0-c9d8-4b11-952f-3d4e4d7140ed service nova] Enqueued Resource ID: b6e35159-57f8-4460-af80-75a4ddc77de5 with Priority: HIGHEST for action port [ 1148.090294] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f with Priority: HIGHEST for action security_group_rules [ 1148.090381] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f with Priority: HIGHEST for action security_group_members [ 1148.090460] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e35159-57f8-4460-af80-75a4ddc77de5 with Priority: HIGHEST for action port [ 1148.090842] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a9aad73-83b3-40ec-b675-e69c4f59ba9f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.090842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.091014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.091165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.091245] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a9aad73-83b3-40ec-b675-e69c4f59ba9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.092104] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.092217] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.092275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.092442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.092594] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.092754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.092807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.093028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.093112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.093164] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a9aad73-83b3-40ec-b675-e69c4f59ba9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.093984] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6e35159-57f8-4460-af80-75a4ddc77de5 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.094124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6e35159-57f8-4460-af80-75a4ddc77de5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.094178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6e35159-57f8-4460-af80-75a4ddc77de5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.094326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6e35159-57f8-4460-af80-75a4ddc77de5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.094397] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6e35159-57f8-4460-af80-75a4ddc77de5',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.324268] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1148.324561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.334106] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.334106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.334106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.334419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.349246] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1148.350212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.351483] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1148.387364] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.387587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.387587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.387785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.399836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.400561] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1148.400643] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1148.400733] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1148.439427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.439654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.439654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.440225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.441933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.442148] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1148.532227] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.532227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.532227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.532414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.532414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.532481] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1148.552603] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.552768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.552841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.553064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.553154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.553249] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be updated. [ 1148.565125] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.565355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.565355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.565542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.565830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.566119] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1148.584576] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.584723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.584768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.584970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.585129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.594994] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1148.596433] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a9aad73-83b3-40ec-b675-e69c4f59ba9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.597574] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.597750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.597832] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6e35159-57f8-4460-af80-75a4ddc77de5 with status ACTIVE [ 1148.597971] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.598052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.598093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.598283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.598371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.598940] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.598940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.598940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.598940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.598940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.599268] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.599268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.599268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.599758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.599758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.599758] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6e35159-57f8-4460-af80-75a4ddc77de5 is going to be updated. [ 1148.602938] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.603059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.603131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.603294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.603426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.613402] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: IN_PROGRESS for 2s [ 1148.622947] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.623138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.623188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.623365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.623494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.623741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6e35159-57f8-4460-af80-75a4ddc77de5" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.666035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.666587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.666681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.666912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.667244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.667598] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:49. [ 1148.667713] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fdbdafb6-4c78-4b83-b960-c24d6a937e53', '2db7096a-5721-4998-9040-4834cd315121', '0d0682cd-eff2-4b3d-abb4-e1d1504a0f61', '8062fa1b-833d-41ea-83be-2da29f1463e8', '3042d77c-efdf-4ff4-8800-d0a920f9e548', 'c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3', '47f32cb1-135b-4397-8ab9-34d019c13eaf', '35157e46-cf93-4f9c-919b-4023c4f96551', '04e3d21c-6754-446b-b0ca-61b5ed8f6a3b', 'fc14a464-84a2-4f30-88ae-7b0da98e4e95', 'b5fc4719-ed06-40a1-9606-7c4ebb5340aa', 'f8701ee7-7415-4cf0-b1a2-be123eab71e4', '6305f884-2f1c-4192-bb40-952ed6eaf542', '468d9cb4-d57c-4a08-8f21-b2ebb70bca61', 'fd672f3d-6117-44aa-8b2f-40dde93f9373', 'ada686fd-cb59-44cf-975b-4402d84546e6', '2904b768-7fb4-4263-a1a8-2deb76da7f25', '94ac6b18-4924-425a-a674-ac5343806fa2', 'e5b339ac-01aa-4f28-9e73-9f48477e571d', '83bf7771-fa03-4285-8780-9b265ead5b3d', 'ad542a16-77ff-4002-b217-5630a01b6f17', '07b5dcdc-e0c4-4d5a-9f24-d000aad5b631', '743c5a69-4fa0-4875-ab4b-14b45b31c03c', 'ef83d33e-bb76-4bd8-9c91-f6567ebf6c19', 'e9c7c205-f0b9-4a7b-b88d-839171878ae3', '085ff348-1812-4078-9ad5-3958496f698b', '3990baf0-9e24-4b70-8c31-60cf273fe344', 'd97c0b7d-58d1-4baf-97be-f3a035518398', '8e8e18e2-41de-44dd-a97f-655de1cca16f', '0a32a98c-e183-4d24-a064-a30e3d8451a7', 'fa6250d1-4a11-4b07-8308-040a7f86026a', 'e6efcb92-8e15-4172-8949-8449dfa15fb3', '159662e6-8d8b-459e-af18-9590760ed457', 'bbdddd19-b5d8-4409-9731-8dacfc9c1c1a', '2af4f432-9b80-40ee-9230-997d5fd46f40', '79256018-f240-48eb-94f9-bc8b0119d8f5', 'c5c06941-63aa-4b49-b9e8-da02d464ab8f', '3e4062aa-2f69-4b3d-8c17-d03ee84455ba', 'dbbd5a6a-d11b-47e8-a835-6b824a5963a5', '08b51b44-1df0-4a96-9da8-8c013955ee0d', '7823ce5a-b26b-47ed-b253-093353398a68', 'dad04559-d224-486f-adbe-3d9a2df06d0a', '698ff167-530f-4085-8a98-c574783d5ed9', '80a77268-fa72-46b8-ba25-eed73b0ba36a', 'ea1a19d6-ac31-4e61-b250-037c90dc02d6', 'c86f328f-f619-4559-ae86-8793a284cfe3', 'b6a73361-0065-4c2b-847b-544a63c06efc', '10e0d2a4-e42f-49c4-b693-268f72e54b08', 'c9813fef-8c97-4cb6-92ff-4d01107ef382'} {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1148.667825] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1148.693735] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.693940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.693940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.694232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.694288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.694378] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1148.694476] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1148.694587] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1148.822133] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 in Status: SUCCESS [ 1148.822336] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a32a98c-e183-4d24-a064-a30e3d8451a7 deletion is rescheduled due to dependency. [ 1148.822500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a32a98c-e183-4d24-a064-a30e3d8451a7" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.862279] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.862445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.862520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.862696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.863902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.864237] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1148.864317] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1148.864393] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1148.864451] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1148.864555] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/49 resources of Type:Security Group Rules [ 1148.864630] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGH for action security_group_rules [ 1148.864717] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGH for action security_group_rules [ 1148.864794] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGH for action security_group_rules [ 1148.864794] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGH for action security_group_rules [ 1148.864957] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGH for action security_group_rules [ 1148.864957] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGH for action security_group_rules [ 1148.865147] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGH for action security_group_rules [ 1148.865147] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGH for action security_group_rules [ 1148.865147] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGH for action security_group_rules [ 1148.865147] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGH for action security_group_rules [ 1148.865428] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGH for action security_group_rules [ 1148.865428] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGH for action security_group_rules [ 1148.865428] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGH for action security_group_rules [ 1148.865428] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGH for action security_group_rules [ 1148.865428] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGH for action security_group_rules [ 1148.865650] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGH for action security_group_rules [ 1148.865650] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGH for action security_group_rules [ 1148.865650] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGH for action security_group_rules [ 1148.865650] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGH for action security_group_rules [ 1148.865842] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGH for action security_group_rules [ 1148.865842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [req-58b9d26c-8a22-4b7b-a668-af88f9282d93 req-ddb81e9a-6ddf-40cf-9b29-858cbbe7546f tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_members [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_members [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 with Priority: HIGH for action security_group_rules [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 with Priority: HIGH for action security_group_rules [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGH for action security_group_rules [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGH for action security_group_rules [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bf7771-fa03-4285-8780-9b265ead5b3d with Priority: HIGH for action security_group_rules [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGH for action security_group_rules [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGH for action security_group_rules [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGH for action security_group_rules [ 1149.059180] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 with Priority: HIGH for action security_group_rules [ 1149.059640] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ada686fd-cb59-44cf-975b-4402d84546e6 with Priority: HIGH for action security_group_rules [ 1149.059640] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 with Priority: HIGH for action security_group_rules [ 1149.059640] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 with Priority: HIGH for action security_group_rules [ 1149.059640] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGH for action security_group_rules [ 1149.059640] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 with Priority: HIGH for action security_group_rules [ 1149.059640] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGH for action security_group_rules [ 1149.059954] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 with Priority: HIGH for action security_group_rules [ 1149.059954] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35157e46-cf93-4f9c-919b-4023c4f96551 with Priority: HIGH for action security_group_rules [ 1149.059954] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGH for action security_group_rules [ 1149.060062] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db7096a-5721-4998-9040-4834cd315121 with Priority: HIGH for action security_group_rules [ 1149.060126] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGH for action security_group_rules [ 1149.060486] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.060614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.060665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.060958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.061108] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.061204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.061260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.061418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.061470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.061574] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.063088] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.063202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.063250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.063414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.064312] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdbdafb6-4c78-4b83-b960-c24d6a937e53',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.064891] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.064891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.065021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.066048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.066048] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0682cd-eff2-4b3d-abb4-e1d1504a0f61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.066048] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.066775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.068115] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.068241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.068309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.068447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.068509] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.069637] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83bf7771-fa03-4285-8780-9b265ead5b3d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.069760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.070446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.070446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.070446] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83bf7771-fa03-4285-8780-9b265ead5b3d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.071903] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.072780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.072780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.072999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.072999] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.074977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94ac6b18-4924-425a-a674-ac5343806fa2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.074977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.074977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.074977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.075339] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.076456] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.077170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.077170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.077170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.077170] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.078432] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.078432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.078432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.078432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.078432] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('468d9cb4-d57c-4a08-8f21-b2ebb70bca61',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.079209] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ada686fd-cb59-44cf-975b-4402d84546e6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.079494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.079577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.079733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.079830] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ada686fd-cb59-44cf-975b-4402d84546e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.081503] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6305f884-2f1c-4192-bb40-952ed6eaf542 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.081503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.081503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.081503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.081503] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6305f884-2f1c-4192-bb40-952ed6eaf542',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.082173] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.082173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.082173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.083221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.083221] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8701ee7-7415-4cf0-b1a2-be123eab71e4',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.083566] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.083566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.083566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.083776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.083776] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.084716] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.084851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.084929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.085039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.085105] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc14a464-84a2-4f30-88ae-7b0da98e4e95',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.087104] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.087229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.087284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.087417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.087483] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.088264] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.088431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.088562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.088662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.088718] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.089580] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35157e46-cf93-4f9c-919b-4023c4f96551 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.089696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.089755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.089903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.090048] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35157e46-cf93-4f9c-919b-4023c4f96551',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.091158] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.091443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.091443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.091788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.091788] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.092558] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2db7096a-5721-4998-9040-4834cd315121 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.092712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.092814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.092889] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.092944] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2db7096a-5721-4998-9040-4834cd315121',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.093606] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.093762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.093762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.094031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.094031] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.100761] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a9aad73-83b3-40ec-b675-e69c4f59ba9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.415320] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.415531] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.415686] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.415952] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.416218] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.416371] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.416484] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.416871] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.417110] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.417352] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1149.417444] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.417572] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.417703] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.418154] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1149.418297] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.418433] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.436853] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.437029] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1149.437172] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.437343] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.437666] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.437925] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.438144] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.438592] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.438825] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80bb26c6-fcfb-484c-b46d-9dd13e4642e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.600303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ac6b18-4924-425a-a674-ac5343806fa2 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.600452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.600503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.600706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.600869] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.600965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.601038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.601186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.601271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.601352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.601434] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.606024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.606024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.606024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.606024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.606024] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.606024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.606024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.606024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.606024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.606024] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.606024] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.607176] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.607320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.607364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.607697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.607697] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.607866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.607866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.607947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.607986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.608097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.608137] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.608907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.609044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.609093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.609261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.609344] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.609432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.609528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.609817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.609817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.609817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.609938] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.612099] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.612099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.612208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.612318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.619908] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.619908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.619908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.620077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.620361] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.620468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.620534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.620703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.621250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.621300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.621380] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.627826] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.627948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.630019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.630019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.630019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.630019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.630019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.630019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.630019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.630019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.630019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.630019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.630019] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.636157] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.636268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.636337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.636500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.636678] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.636771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.636829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.637018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.637101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.637171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.637260] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.638899] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.639048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.639111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.639246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.639324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.641019] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f is going to be created. [ 1149.683851] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.684226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.685240] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.685342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.689145] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.689145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.691682] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.691796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.692551] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.692647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.693826] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.693945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.695283] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.695283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.695541] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.695657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.697237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.697237] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc14a464-84a2-4f30-88ae-7b0da98e4e95 is going to be deleted. [ 1149.697367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.697647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.697767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.699115] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.699115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.699115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.699115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.699115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.699115] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 already deleted. [ 1149.699115] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.699538] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.699656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.699729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.699885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.701276] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.701371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.702054] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.702150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.706202] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1149.706202] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.706202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.706202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.706202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.706202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.713327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f in Status: UNINITIALIZED for 2s [ 1149.720101] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1149.720477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.720590] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83bf7771-fa03-4285-8780-9b265ead5b3d is going to be deleted. [ 1149.721471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.721672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.765829] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.766011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.766944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.767061] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be deleted. [ 1149.767981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.768204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.797970] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.798194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.799050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.799170] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdbdafb6-4c78-4b83-b960-c24d6a937e53 is going to be deleted. [ 1149.800044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.800258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.828847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.829053] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8701ee7-7415-4cf0-b1a2-be123eab71e4 is going to be deleted. [ 1149.829987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.830138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.875812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.875992] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6305f884-2f1c-4192-bb40-952ed6eaf542 is going to be deleted. [ 1149.877081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.877373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.941381] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.941605] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.942187] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.942187] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.942364] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.942500] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 80bb26c6-fcfb-484c-b46d-9dd13e4642e6 not found, creating... [ 1149.942770] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.942932] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.943061] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.943300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.943437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.943736] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.943893] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.944016] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.944236] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.944369] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.944532] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 80bb26c6-fcfb-484c-b46d-9dd13e4642e6 is going to be created. [ 1149.948578] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.948708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.957234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.957402] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ada686fd-cb59-44cf-975b-4402d84546e6 is going to be deleted. [ 1149.958275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.958490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.961818] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.961818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.980312] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.980671] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.980671] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.980929] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.981176] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.981398] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.027599] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.027913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.032258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.032494] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2db7096a-5721-4998-9040-4834cd315121 is going to be deleted. [ 1150.033383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.033620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.064207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.064424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.098693] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.098928] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3 is going to be deleted. [ 1150.099788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.100212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.107447] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.107645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.107645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.108482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.108482] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.108482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.108482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.108482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.108482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.108482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.108828] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.108828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.108828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.109023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.109114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.109171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.109223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.109493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.109493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.109493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.109600] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.119148] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.120194] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.141436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.141641] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0682cd-eff2-4b3d-abb4-e1d1504a0f61 is going to be deleted. [ 1150.142545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.142987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.143735] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.143857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.143925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.144126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.144250] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.144377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.144481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.144659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.144772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.144865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.145035] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.145133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.145199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.146266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.146266] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.146266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.146266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.146266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.146266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.146266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.146266] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.147812] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.147948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.148030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.148151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.148299] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.148415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.148479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.148583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.148657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.148738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.148883] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.148992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.149069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.149199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.149362] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.149491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.149491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.149616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.149687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.149764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.149849] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.151798] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.151956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.151956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.152174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.152269] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.152366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.152526] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.152578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.152629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.152708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.152852] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.152943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.153009] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.153154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.153292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.153382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.153451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.153606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.153681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.153759] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.153847] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.156853] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.156953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.157034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.157198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.157343] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.157435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.157492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.157630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.157707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.157785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.157924] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.158020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.158081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.158215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.158347] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.158436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.158525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.158617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.158690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.158766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.158853] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.162985] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.162985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.193253] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.193511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.213911] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.214231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.216730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.217084] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 468d9cb4-d57c-4a08-8f21-b2ebb70bca61 is going to be deleted. [ 1150.218153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.218376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.250192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.250341] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35157e46-cf93-4f9c-919b-4023c4f96551 is going to be deleted. [ 1150.251285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.251531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.251834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.251834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc14a464-84a2-4f30-88ae-7b0da98e4e95" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.251942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.252034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.252110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.252339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83bf7771-fa03-4285-8780-9b265ead5b3d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.252863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.252935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.252989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.253397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.253397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.253397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.253537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.253574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdbdafb6-4c78-4b83-b960-c24d6a937e53" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.253942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.253942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.253942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.254408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6305f884-2f1c-4192-bb40-952ed6eaf542" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.254408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.254408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.254408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.254408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8701ee7-7415-4cf0-b1a2-be123eab71e4" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.254806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.254806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.254806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.254994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ada686fd-cb59-44cf-975b-4402d84546e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.255187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.255394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.255464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.255512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2db7096a-5721-4998-9040-4834cd315121" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.255705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.255793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.255907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.255907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1e6e6c1-4bc5-4c54-85b6-ae8e1a47f6f3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.312398] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.312550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.312611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.312818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.312935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.313036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0682cd-eff2-4b3d-abb4-e1d1504a0f61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.341729] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.341877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.341945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.342172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.342262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.342381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-468d9cb4-d57c-4a08-8f21-b2ebb70bca61" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.344631] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1150.345548] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.345548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.345548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.345548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.345548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.345548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35157e46-cf93-4f9c-919b-4023c4f96551" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.606697] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1150.607434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.607718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.608064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.608318] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.608500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.608614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.608873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.608984] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.609372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.609677] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.609775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.609839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.610028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.610333] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.611703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.611703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.611703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.611848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.611946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.612203] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.613310] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5fc4719-ed06-40a1-9606-7c4ebb5340aa: rpc.has_security_group_logging(os_id): False [ 1150.621579] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2904b768-7fb4-4263-a1a8-2deb76da7f25: rpc.has_security_group_logging(os_id): False [ 1150.622550] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94ac6b18-4924-425a-a674-ac5343806fa2: rpc.has_security_group_logging(os_id): False [ 1150.624251] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: SUCCESS [ 1150.624949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.625248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.626075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.626075] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.626210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.626210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.626363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.626415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.626485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.626602] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.635727] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.635834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.635941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.636116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.641023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.641023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.641023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.641023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.648816] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3042d77c-efdf-4ff4-8800-d0a920f9e548: rpc.has_security_group_logging(os_id): False [ 1150.652631] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd672f3d-6117-44aa-8b2f-40dde93f9373: rpc.has_security_group_logging(os_id): False [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.658019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.658019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.658019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.658019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.658593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.658593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.658593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.658593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.658593] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be updated. [ 1150.659349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.659501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.662744] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8062fa1b-833d-41ea-83be-2da29f1463e8: rpc.has_security_group_logging(os_id): False [ 1150.665187] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b: rpc.has_security_group_logging(os_id): False [ 1150.672011] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.672200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.676354] env[65899]: INFO networking_nsxv3.common.synchronization [req-58b9d26c-8a22-4b7b-a668-af88f9282d93 req-60c58c6c-91a6-413b-9585-379b0d24bc22 service nova] Enqueued Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_rules [ 1150.676528] env[65899]: INFO networking_nsxv3.common.synchronization [req-58b9d26c-8a22-4b7b-a668-af88f9282d93 req-60c58c6c-91a6-413b-9585-379b0d24bc22 service nova] Enqueued Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_members [ 1150.676732] env[65899]: INFO networking_nsxv3.common.synchronization [req-58b9d26c-8a22-4b7b-a668-af88f9282d93 req-60c58c6c-91a6-413b-9585-379b0d24bc22 service nova] Enqueued Resource ID: 80bb26c6-fcfb-484c-b46d-9dd13e4642e6 with Priority: HIGHEST for action port [ 1150.676976] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_rules [ 1150.677122] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_members [ 1150.677247] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80bb26c6-fcfb-484c-b46d-9dd13e4642e6 with Priority: HIGHEST for action port [ 1150.678521] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.678643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.679055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.679277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.679363] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.680333] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.680702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.680783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.680958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.681124] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.681223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.681281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.681417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.681498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.681587] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.685996] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.685996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.685996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.685996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.685996] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80bb26c6-fcfb-484c-b46d-9dd13e4642e6',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.687171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.687421] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.687610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.687610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.687734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.687809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.687901] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 is going to be updated. [ 1150.690168] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.690290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.690376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.690544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.692414] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.692414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.693142] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.693253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.716284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.716284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.716284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.716284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.716897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.716897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.716897] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1150.720309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.721331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.736246] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.736246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.745512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.747942] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.748417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.748508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.749150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.749150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.749150] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.749428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.749428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.749831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.749831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.750145] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.752552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.754094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.754094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.754094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.754094] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be updated. [ 1150.754289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.754498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.779916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.780574] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.780574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.780574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.780828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.781365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.781533] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94ac6b18-4924-425a-a674-ac5343806fa2 is going to be updated. [ 1150.782736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.783018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.787993] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.787993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.819321] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.819521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.836687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.837038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.837159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.837222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.837419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.837497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.838251] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.838251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.838251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.838251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.838251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.838445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.838445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.838537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.838626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.838701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.838791] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1150.840254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.840426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.863055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.863271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.920010] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.920345] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.920410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.920578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.920714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.920772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.921415] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.921415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.921415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.921415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.921415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.921669] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.921669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.921669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.921810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.921810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.921898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be updated. [ 1150.923945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.923945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.923945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.924783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.924983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.925344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.927144] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.927144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.927144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.927309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.927576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.928267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.928447] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.928582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.929517] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.929677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.929810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.988778] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: IN_PROGRESS for 2s [ 1150.988778] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1150.989210] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1150.989354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.990170] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 in Status: IN_PROGRESS for 2s [ 1150.990616] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1151.019187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.019555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.019555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.020062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.020062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.071581] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1151.084918] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.084918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.084918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.084918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.084918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.116336] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10e0d2a4-e42f-49c4-b693-268f72e54b08: rpc.has_security_group_logging(os_id): False [ 1151.128490] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.133786] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: IN_PROGRESS for 2s [ 1151.157267] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.157494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.157661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.157805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.188145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.188145] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.188385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.188385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.188525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.188593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.188812] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.189263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.189263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.189395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.189490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.189709] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.189832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.189936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.191128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.191230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.191413] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1151.193549] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.193549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.193872] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.195742] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80bb26c6-fcfb-484c-b46d-9dd13e4642e6 with status ACTIVE [ 1151.195880] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.195982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.196056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.196521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.196521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.196521] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.196747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.196747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.196891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.197013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.197163] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.197344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.197344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.197469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.197838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.197838] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80bb26c6-fcfb-484c-b46d-9dd13e4642e6 is going to be updated. [ 1151.240955] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.240955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.240955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.241191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.241229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.241396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80bb26c6-fcfb-484c-b46d-9dd13e4642e6" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.321799] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.322050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.322206] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.322468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.322639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.343608] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1151.632032] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47f32cb1-135b-4397-8ab9-34d019c13eaf: rpc.has_security_group_logging(os_id): False [ 1151.652741] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.653026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.653026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.653227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.672509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.673284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.673284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.673284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.673284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.673284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.673575] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be updated. [ 1151.684708] env[65899]: INFO networking_nsxv3.common.synchronization [req-e2ae5933-66a9-42fb-a154-0b6ec3bc8b95 req-bfaee9bd-c96d-4e56-bb2b-e192fefe09b8 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1151.684917] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1151.685271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.685428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.685553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.685648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.685791] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.685885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.685946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.686090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.686320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.686320] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.699995] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.723777] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f in Status: SUCCESS [ 1151.723981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.724145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.724342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.724534] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.724668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.724754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.724846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.724914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.725011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.725113] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a9aad73-83b3-40ec-b675-e69c4f59ba9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.734517] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.734699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.734809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.735041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.735197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.751744] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: IN_PROGRESS for 2s [ 1152.155829] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.156057] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.156161] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.156421] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.156740] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.156932] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.157026] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.157247] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.157393] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.157603] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.157748] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.157909] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.158035] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.158150] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.158246] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.158380] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.178477] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.178708] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.178790] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.178948] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.179320] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-cfd4afb3-9b84-4862-88c8-bf0432e50293 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.179495] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-cfd4afb3-9b84-4862-88c8-bf0432e50293" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.179615] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-cfd4afb3-9b84-4862-88c8-bf0432e50293" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.179955] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-cfd4afb3-9b84-4862-88c8-bf0432e50293" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.180116] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd4afb3-9b84-4862-88c8-bf0432e50293',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.188589] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.202854] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.202854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.203084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.203515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.203515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.203515] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 is going to be created. [ 1152.231359] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.231524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.231581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.231787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.231963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.233125] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.233764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.233764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.233764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.233764] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.233764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.233764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.234599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.234599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.234599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.234599] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.234599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.234599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.234599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.234599] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.234936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.234936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.234936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.234936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.234936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.235132] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a9aad73-83b3-40ec-b675-e69c4f59ba9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.246506] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 in Status: UNINITIALIZED for 2s [ 1152.684711] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.684711] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.684910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.685069] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.685759] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.685759] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port cfd4afb3-9b84-4862-88c8-bf0432e50293 not found, creating... [ 1152.685759] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.685759] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.686049] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.686090] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.686226] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.687321] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.687321] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.687321] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.687321] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.687662] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.687662] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: cfd4afb3-9b84-4862-88c8-bf0432e50293 is going to be created. [ 1152.690613] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.709619] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.710667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.710667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.710667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.710667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.710667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-cfd4afb3-9b84-4862-88c8-bf0432e50293" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.737342] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a9aad73-83b3-40ec-b675-e69c4f59ba9f: rpc.has_security_group_logging(os_id): False [ 1152.755414] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.755414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.755633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.755669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.756562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.756562] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.756562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.756562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.756562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.756562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.756917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.756917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.757016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.757092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.757162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.757501] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.757662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.757793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.757968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.758079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.758184] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f is going to be created. [ 1152.821888] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.822066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.822132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.822347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.822529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.846978] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f in Status: IN_PROGRESS for 2s [ 1153.004110] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 in Status: SUCCESS [ 1153.004334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.005170] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: SUCCESS [ 1153.005345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.006366] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1153.006575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.008738] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1153.008987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.079913] env[65899]: INFO networking_nsxv3.common.synchronization [req-7db2271b-5a44-49f8-a65c-89437dbba27d req-b4f56a7a-5dcf-441b-9793-da536e3a3b05 tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1153.080455] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1153.080974] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.080974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.080974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.081186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.081336] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.081435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.081551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.081786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.081939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.082088] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.093012] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1153.093012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.149439] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: SUCCESS [ 1153.149655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.192569] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.193090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.193236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.193457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.193541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.193639] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a73361-0065-4c2b-847b-544a63c06efc is going to be updated. [ 1153.222751] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.222905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.223026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.223490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.223490] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.245559] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: IN_PROGRESS for 2s [ 1153.358663] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1153.358663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.358663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.359069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.359069] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.429958] env[65899]: INFO networking_nsxv3.common.synchronization [req-e2ae5933-66a9-42fb-a154-0b6ec3bc8b95 req-867fad80-d65d-4602-a288-fc878871ff3c service nova] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_rules [ 1153.430196] env[65899]: INFO networking_nsxv3.common.synchronization [req-e2ae5933-66a9-42fb-a154-0b6ec3bc8b95 req-867fad80-d65d-4602-a288-fc878871ff3c service nova] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1153.430196] env[65899]: INFO networking_nsxv3.common.synchronization [req-e2ae5933-66a9-42fb-a154-0b6ec3bc8b95 req-867fad80-d65d-4602-a288-fc878871ff3c service nova] Enqueued Resource ID: cfd4afb3-9b84-4862-88c8-bf0432e50293 with Priority: HIGHEST for action port [ 1153.432168] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_rules [ 1153.432486] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1153.432727] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfd4afb3-9b84-4862-88c8-bf0432e50293 with Priority: HIGHEST for action port [ 1153.435069] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.435069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.435069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.435069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.435069] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.435359] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.435359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.435491] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfd4afb3-9b84-4862-88c8-bf0432e50293 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.435560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfd4afb3-9b84-4862-88c8-bf0432e50293" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.435596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfd4afb3-9b84-4862-88c8-bf0432e50293" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.435746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfd4afb3-9b84-4862-88c8-bf0432e50293" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.435819] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd4afb3-9b84-4862-88c8-bf0432e50293',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.586368] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.586553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.586626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.586896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.609168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.609168] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.609168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.609168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.609168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.609168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.609168] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1153.638654] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.639421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.639616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.640515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.640791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.654144] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1153.767266] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: SUCCESS [ 1153.767266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.767266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.767266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.767266] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.863093] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.863307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.863357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.863569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.863767] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.863889] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.863990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.864151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.864232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.864323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.864443] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.944435] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.944435] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfd4afb3-9b84-4862-88c8-bf0432e50293 with status ACTIVE [ 1153.944435] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.944435] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.944435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.949478] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.949478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.949478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.949478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.949478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.949478] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfd4afb3-9b84-4862-88c8-bf0432e50293 is going to be updated. [ 1153.974963] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.975174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.975295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.975469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.975605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.975773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfd4afb3-9b84-4862-88c8-bf0432e50293" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.266433] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 in Status: SUCCESS [ 1154.268261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.268261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.268261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.268261] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.268807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.268807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.268998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.269069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.269169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.269267] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.270988] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.271155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.271205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.271452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.271703] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.271703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.271703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.272205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.272205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.272205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.272205] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.367068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.367452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.367719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.368337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.369038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.369375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.371259] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.371259] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.371259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.372209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.372427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.372700] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.772169] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.775411] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.867305] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f in Status: SUCCESS [ 1154.868259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.878433] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10e0d2a4-e42f-49c4-b693-268f72e54b08: rpc.has_security_group_logging(os_id): False [ 1154.906116] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.906116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.906116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.906116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.906116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.906400] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.906469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.906469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.907242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.907242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.907242] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.907420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.907457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.907728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.907830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.908014] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.908157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.908219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.908364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.908435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.908518] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1154.983154] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.983154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.983154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.983647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.984773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.007877] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1155.256987] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: SUCCESS [ 1155.257242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.257498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.257764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.257955] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.258113] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.258152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.258443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.258443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.258443] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.274953] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15: rpc.has_security_group_logging(os_id): False [ 1155.278032] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47f32cb1-135b-4397-8ab9-34d019c13eaf: rpc.has_security_group_logging(os_id): False [ 1155.296190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.296516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.296516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.296600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.296685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.297235] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.297235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.297235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.297235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.297478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.297478] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 is going to be created. [ 1155.301513] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.301643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.301692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.301870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.301955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.302182] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.302281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.302344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.302491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.302568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.302652] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be updated. [ 1155.374056] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.374209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.374258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.374554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.378023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.380660] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.380793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.380863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.381136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.381198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.408935] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 in Status: IN_PROGRESS for 2s [ 1155.412923] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: IN_PROGRESS for 2s [ 1155.666032] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1155.666032] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1155.666032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.760775] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.263402] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.765887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.766139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.766229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.766459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.766553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.766772] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a73361-0065-4c2b-847b-544a63c06efc is going to be updated. [ 1156.800563] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.803019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.803019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.803019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.803019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.812693] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: IN_PROGRESS for 2s [ 1157.027041] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1157.027278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.424026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 in Status: SUCCESS [ 1157.424523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.426605] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: SUCCESS [ 1157.426895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.434632] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1158.434632] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1158.825355] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: SUCCESS [ 1158.825610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.825863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.826191] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.826409] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.826553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.826679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.826919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.827330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.827330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.827330] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.960024] env[65899]: INFO networking_nsxv3.common.synchronization [req-c2cff66a-590f-4971-af1b-583f6fcc31f9 req-f0e53bf1-2d1a-4df6-8b10-543e805056fb tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1158.960473] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1158.965622] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.965782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.965848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.966559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.966559] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.966559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.966559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.966559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.967032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.967032] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.329940] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.356863] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.357139] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-556" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.357269] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-556" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.357537] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-556" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.357870] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.358041] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.358104] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.358298] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.358439] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.358639] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.358778] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.358907] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.359027] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.359139] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.359245] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.359369] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.381099] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.381243] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.381371] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.381554] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-556" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.381857] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-912c1ccf-0381-41cf-b896-f3dfc18c1223 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.382391] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.382391] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.382475] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.382629] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912c1ccf-0381-41cf-b896-f3dfc18c1223',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.470926] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.596420] env[65899]: INFO networking_nsxv3.common.synchronization [req-01a69e11-60d4-4ff9-8fde-72ebe0ad48f2 req-54d87fe9-859e-4a52-8d54-df2875e41a64 tempest-ServersAdminTestJSON-2084545516 tempest-ServersAdminTestJSON-2084545516-project-member] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1159.597311] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1159.598174] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.598174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.598174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.598174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.598510] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.598510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.598656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.598825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.598946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.599205] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.832662] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6a73361-0065-4c2b-847b-544a63c06efc: rpc.has_security_group_logging(os_id): False [ 1159.854786] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.854951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.855037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.855262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.877340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.877695] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.877842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.877913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.878135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.878213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.878386] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6a73361-0065-4c2b-847b-544a63c06efc is going to be updated. [ 1159.884991] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.885224] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.885344] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.885602] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.885743] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.885888] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 912c1ccf-0381-41cf-b896-f3dfc18c1223 not found, creating... [ 1159.886164] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.886323] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.886435] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.886661] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.886871] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.887176] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.887348] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.887462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.887711] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.887844] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.887995] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 is going to be created. [ 1159.908609] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.908942] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.908942] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.910088] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.910088] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.910088] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.953626] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.953862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.953862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.954143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.954296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.968968] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: IN_PROGRESS for 2s [ 1159.972691] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.101434] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.476976] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.476976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.476976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.476976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.476976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.477494] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1160.513184] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.513350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.513833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.513833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.513833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.524309] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1160.605017] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.666055] env[65899]: INFO networking_nsxv3.common.synchronization [req-c2cff66a-590f-4971-af1b-583f6fcc31f9 req-37199df6-b66d-4818-bc55-1794492f448e service nova] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1160.666055] env[65899]: INFO networking_nsxv3.common.synchronization [req-c2cff66a-590f-4971-af1b-583f6fcc31f9 req-37199df6-b66d-4818-bc55-1794492f448e service nova] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1160.666055] env[65899]: INFO networking_nsxv3.common.synchronization [req-c2cff66a-590f-4971-af1b-583f6fcc31f9 req-37199df6-b66d-4818-bc55-1794492f448e service nova] Enqueued Resource ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 with Priority: HIGHEST for action port [ 1160.666055] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1160.666055] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1160.666055] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 with Priority: HIGHEST for action port [ 1160.666055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.666055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.666055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.666583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.666583] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.667188] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.667871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.667871] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-912c1ccf-0381-41cf-b896-f3dfc18c1223 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.667871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.667871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.667871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.667871] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912c1ccf-0381-41cf-b896-f3dfc18c1223',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.109953] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.110122] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.110201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.110419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.110512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.110635] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1161.141377] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.141538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.141581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.142241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.142241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.153090] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1161.210187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.210187] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 912c1ccf-0381-41cf-b896-f3dfc18c1223 with status ACTIVE [ 1161.210187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.210187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.210187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.210187] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.210712] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 is going to be updated. [ 1161.210712] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.210712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.691558] env[65899]: INFO networking_nsxv3.common.synchronization [req-250d6250-6b2a-4b14-bff5-db6eb4cd565c req-5c6a6988-4795-455f-9b81-37253670f0cf tempest-ServerAddressesTestJSON-480126856 tempest-ServerAddressesTestJSON-480126856-project-member] Enqueued Resource ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f with Priority: HIGHEST for action security_group_members [ 1161.692189] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f with Priority: HIGHEST for action security_group_members [ 1161.692523] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.692639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.692702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.693025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.693076] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.693175] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.693221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.694654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.694654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.694654] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a9aad73-83b3-40ec-b675-e69c4f59ba9f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.983483] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: SUCCESS [ 1161.983956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.194350] env[65899]: INFO networking_nsxv3.common.synchronization [req-9971e558-add8-49bb-8779-3621d08a8b1c req-656dd5f7-d705-4bee-9049-14314c3a3913 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1162.194524] env[65899]: INFO networking_nsxv3.common.synchronization [req-9971e558-add8-49bb-8779-3621d08a8b1c req-656dd5f7-d705-4bee-9049-14314c3a3913 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: edd04021-574c-44b2-a8e2-86a06190f4c1 with Priority: HIGHEST for action security_group_members [ 1162.195070] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1162.195325] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd04021-574c-44b2-a8e2-86a06190f4c1 with Priority: HIGHEST for action security_group_members [ 1162.195530] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.195647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.195710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.195914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.195997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.197073] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.197073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.197073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.197073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.197073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.197073] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f is going to be updated. [ 1162.198177] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.198281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.198338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.198491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.198629] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.198793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.198793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.202154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.202154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.202154] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.202154] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd04021-574c-44b2-a8e2-86a06190f4c1 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.202154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.202720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.203063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.203271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.203399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.203496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.203837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.203837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.204146] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.234861] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.235877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.236073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.236336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.236482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.245808] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f in Status: IN_PROGRESS for 2s [ 1162.250627] env[65899]: INFO networking_nsxv3.common.synchronization [req-9971e558-add8-49bb-8779-3621d08a8b1c req-656dd5f7-d705-4bee-9049-14314c3a3913 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_rules [ 1162.250799] env[65899]: INFO networking_nsxv3.common.synchronization [req-9971e558-add8-49bb-8779-3621d08a8b1c req-656dd5f7-d705-4bee-9049-14314c3a3913 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1162.250998] env[65899]: INFO networking_nsxv3.common.synchronization [req-9971e558-add8-49bb-8779-3621d08a8b1c req-656dd5f7-d705-4bee-9049-14314c3a3913 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: edd04021-574c-44b2-a8e2-86a06190f4c1 with Priority: HIGHEST for action security_group_rules [ 1162.251178] env[65899]: INFO networking_nsxv3.common.synchronization [req-9971e558-add8-49bb-8779-3621d08a8b1c req-656dd5f7-d705-4bee-9049-14314c3a3913 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: edd04021-574c-44b2-a8e2-86a06190f4c1 with Priority: HIGHEST for action security_group_members [ 1162.251314] env[65899]: INFO networking_nsxv3.common.synchronization [req-9971e558-add8-49bb-8779-3621d08a8b1c req-656dd5f7-d705-4bee-9049-14314c3a3913 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: da8a0633-832c-4253-8d78-3c1b68f686b9 with Priority: HIGHEST for action port [ 1162.251975] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_rules [ 1162.252634] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd04021-574c-44b2-a8e2-86a06190f4c1 with Priority: HIGHEST for action security_group_rules [ 1162.252764] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da8a0633-832c-4253-8d78-3c1b68f686b9 with Priority: HIGHEST for action port [ 1162.252874] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1162.253857] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd04021-574c-44b2-a8e2-86a06190f4c1 with Priority: HIGHEST for action security_group_members [ 1162.254194] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.254358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.254395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.254584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.254665] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.255679] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edd04021-574c-44b2-a8e2-86a06190f4c1 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.255770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.255770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.257134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.257134] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.257134] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-da8a0633-832c-4253-8d78-3c1b68f686b9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.257134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.257387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.257387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.257638] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8a0633-832c-4253-8d78-3c1b68f686b9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.259620] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.259766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.260282] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd04021-574c-44b2-a8e2-86a06190f4c1 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.260367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.535129] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1162.537269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.537269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.537269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.537269] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.537269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.537269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.537269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.537269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.537269] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.708220] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.708220] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.762353] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.762789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.765481] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da8a0633-832c-4253-8d78-3c1b68f686b9 with status ACTIVE [ 1162.765481] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.765481] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.765481] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.765481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.765481] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da8a0633-832c-4253-8d78-3c1b68f686b9 is going to be updated. [ 1162.767418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd04021-574c-44b2-a8e2-86a06190f4c1 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.768189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.789461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.789700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.789827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.790173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.790412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.790664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.906328] env[65899]: INFO networking_nsxv3.common.synchronization [req-125f979a-7de9-42bc-ae2e-1943615f7d7c req-d44013c3-da9d-4ca8-b067-0d403a439749 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1162.906526] env[65899]: INFO networking_nsxv3.common.synchronization [req-125f979a-7de9-42bc-ae2e-1943615f7d7c req-d44013c3-da9d-4ca8-b067-0d403a439749 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: edd04021-574c-44b2-a8e2-86a06190f4c1 with Priority: HIGHEST for action security_group_members [ 1162.907115] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1162.907253] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edd04021-574c-44b2-a8e2-86a06190f4c1 with Priority: HIGHEST for action security_group_members [ 1162.907842] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.908164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.908230] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-edd04021-574c-44b2-a8e2-86a06190f4c1 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.908273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.963022] env[65899]: INFO networking_nsxv3.common.synchronization [req-125f979a-7de9-42bc-ae2e-1943615f7d7c req-d44013c3-da9d-4ca8-b067-0d403a439749 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_rules [ 1162.963234] env[65899]: INFO networking_nsxv3.common.synchronization [req-125f979a-7de9-42bc-ae2e-1943615f7d7c req-d44013c3-da9d-4ca8-b067-0d403a439749 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1162.963500] env[65899]: INFO networking_nsxv3.common.synchronization [req-125f979a-7de9-42bc-ae2e-1943615f7d7c req-d44013c3-da9d-4ca8-b067-0d403a439749 tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: da8a0633-832c-4253-8d78-3c1b68f686b9 with Priority: HIGHEST for action port [ 1162.966783] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_rules [ 1162.966783] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1162.966783] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da8a0633-832c-4253-8d78-3c1b68f686b9 with Priority: HIGHEST for action port [ 1162.966783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.966783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.966783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.966783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.966783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-da8a0633-832c-4253-8d78-3c1b68f686b9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.966783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.966783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.966783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.966783] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da8a0633-832c-4253-8d78-3c1b68f686b9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.039529] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.163311] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1163.164038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.210488] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.211621] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.363034] env[65899]: INFO networking_nsxv3.common.synchronization [req-421a110d-b5db-4cd7-bc28-4f75a3837252 req-f089a3a5-fd12-4599-bd47-799e510150d5 tempest-AttachVolumeTestJSON-2123047702 tempest-AttachVolumeTestJSON-2123047702-project-member] Enqueued Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_members [ 1163.363569] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGHEST for action security_group_members [ 1163.363931] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.364454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.365467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.365775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.366198] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.366388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.366885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.368558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.368712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.368865] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.469053] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da8a0633-832c-4253-8d78-3c1b68f686b9 with status ACTIVE [ 1163.469298] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.469433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.469502] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.469706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.469799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.469977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.470088] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.470148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.470292] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.470366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.470540] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.470630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.470689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.470824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.470897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.470976] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da8a0633-832c-4253-8d78-3c1b68f686b9 is going to be updated. [ 1163.496917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.498280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.498453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.498672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.498897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.502019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da8a0633-832c-4253-8d78-3c1b68f686b9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.540894] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.714544] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.714946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.715023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.715230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.715316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.715414] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd04021-574c-44b2-a8e2-86a06190f4c1 is going to be created. [ 1163.716783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.716909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.716980] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.717153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.717261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.717380] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be updated. [ 1163.742375] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.742519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.746133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.746133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.746133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.746133] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.746133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.746133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.746133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.746410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.755330] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd04021-574c-44b2-a8e2-86a06190f4c1 in Status: UNINITIALIZED for 2s [ 1163.755979] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: IN_PROGRESS for 2s [ 1163.872878] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.873085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.873158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.873394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.873488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.873720] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.873825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.873887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.874058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.874141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.874232] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 is going to be updated. [ 1163.904965] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.905135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.905868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.906165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.906322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.918341] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 in Status: IN_PROGRESS for 2s [ 1164.046080] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.046265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.046356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.046584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.046698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.046856] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1164.075422] env[65899]: INFO networking_nsxv3.common.synchronization [None req-300f1e70-15d5-48b2-8a2b-973ee722fb44 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1164.076073] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1164.076300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.076464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.076508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.076697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.076919] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.081838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.081838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.081838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.081838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.081838] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.084096] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.084291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.084400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.084624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.084926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.097894] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1164.257463] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f in Status: SUCCESS [ 1164.257463] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a9aad73-83b3-40ec-b675-e69c4f59ba9f deletion is rescheduled due to dependency. [ 1164.257463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a9aad73-83b3-40ec-b675-e69c4f59ba9f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.493710] env[65899]: INFO networking_nsxv3.common.synchronization [req-901cf3db-7e59-474b-9679-eec1124103d7 req-fcca146f-e148-42b9-bf19-093daae0edec tempest-InstanceActionsTestJSON-654101570 tempest-InstanceActionsTestJSON-654101570-project-member] Enqueued Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGHEST for action security_group_members [ 1164.494276] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGHEST for action security_group_members [ 1164.495820] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-046b28ff-80bf-405a-859e-0080bd4c492a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.495820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.495820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.495820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.495820] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.495820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.495820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.495820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.495820] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.495820] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.581318] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.581595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.581691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.581931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.582019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.582240] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.582335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.582395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.582535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.582834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.582834] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be deleted. [ 1164.616040] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.616249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.616322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.616535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.616619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.616717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.831162] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-658 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.831162] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-658" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.831162] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-658" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.831162] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-658" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.831162] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.831162] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.831162] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.832133] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.832429] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.832756] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.832990] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.833253] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.833483] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.835605] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.835605] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.835605] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.871729] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.872286] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1164.872614] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.872913] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-658" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.873425] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-4befcb39-ac50-48cd-a7e2-33e9196fe602 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.873999] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-4befcb39-ac50-48cd-a7e2-33e9196fe602" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.875085] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-4befcb39-ac50-48cd-a7e2-33e9196fe602" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.875085] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-4befcb39-ac50-48cd-a7e2-33e9196fe602" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.875085] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4befcb39-ac50-48cd-a7e2-33e9196fe602',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.998863] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.999047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.999047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.999277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.999366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.999556] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.999653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.999714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.999951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.000038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.000125] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046b28ff-80bf-405a-859e-0080bd4c492a already deleted. [ 1165.000203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.380253] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.380718] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.381904] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.382484] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.382808] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.383296] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 4befcb39-ac50-48cd-a7e2-33e9196fe602 not found, creating... [ 1165.383750] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.383988] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.384250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.384629] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.384835] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.385368] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.385612] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.386046] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.386246] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.386884] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.387253] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 4befcb39-ac50-48cd-a7e2-33e9196fe602 is going to be created. [ 1165.421904] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.422234] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.422443] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.422915] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.423163] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.423589] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-4befcb39-ac50-48cd-a7e2-33e9196fe602" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.767707] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: IN_PROGRESS for 4s [ 1165.768461] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd04021-574c-44b2-a8e2-86a06190f4c1 in Status: UNINITIALIZED for 4s [ 1165.929602] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 in Status: SUCCESS [ 1165.929877] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 deletion is rescheduled due to dependency. [ 1165.929877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.109219] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1166.109700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.109700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.109916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.110127] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.110246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.110312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.110470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.110551] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.110634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.110727] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.122521] env[65899]: INFO networking_nsxv3.common.synchronization [req-901cf3db-7e59-474b-9679-eec1124103d7 req-c24f8161-5963-45cc-aff7-9099410d1bd3 service nova] Enqueued Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGHEST for action security_group_rules [ 1166.123082] env[65899]: INFO networking_nsxv3.common.synchronization [req-901cf3db-7e59-474b-9679-eec1124103d7 req-c24f8161-5963-45cc-aff7-9099410d1bd3 service nova] Enqueued Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGHEST for action security_group_members [ 1166.123082] env[65899]: INFO networking_nsxv3.common.synchronization [req-901cf3db-7e59-474b-9679-eec1124103d7 req-c24f8161-5963-45cc-aff7-9099410d1bd3 service nova] Enqueued Resource ID: 4befcb39-ac50-48cd-a7e2-33e9196fe602 with Priority: HIGHEST for action port [ 1166.123372] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGHEST for action security_group_rules [ 1166.123614] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGHEST for action security_group_members [ 1166.123614] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4befcb39-ac50-48cd-a7e2-33e9196fe602 with Priority: HIGHEST for action port [ 1166.123867] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-046b28ff-80bf-405a-859e-0080bd4c492a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.123987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.124352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.124633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.124716] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.127488] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-046b28ff-80bf-405a-859e-0080bd4c492a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.129252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.129332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.129530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.129703] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.129809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.129871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.130023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.130109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.130202] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.132949] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-4befcb39-ac50-48cd-a7e2-33e9196fe602 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.133740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4befcb39-ac50-48cd-a7e2-33e9196fe602" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.133740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4befcb39-ac50-48cd-a7e2-33e9196fe602" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.133740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4befcb39-ac50-48cd-a7e2-33e9196fe602" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.133740] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4befcb39-ac50-48cd-a7e2-33e9196fe602',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.613070] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.613291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.613385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.613635] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.613871] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.614012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.614057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.614260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.614368] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.614482] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.614660] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.614805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.614882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.615083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.615318] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.615460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.615460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.615625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.615731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.615839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.615951] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.628557] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-046b28ff-80bf-405a-859e-0080bd4c492a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.628720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.635593] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.636689] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4befcb39-ac50-48cd-a7e2-33e9196fe602 with status ACTIVE [ 1166.636979] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.637150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.637218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.637493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.637589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.637805] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.643878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.643978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.644222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.644311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.644561] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.644674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.644748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.646060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.646424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.646424] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4befcb39-ac50-48cd-a7e2-33e9196fe602 is going to be updated. [ 1166.670166] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.670325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.670387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.671590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.671590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.671590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4befcb39-ac50-48cd-a7e2-33e9196fe602" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.117825] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10e0d2a4-e42f-49c4-b693-268f72e54b08: rpc.has_security_group_logging(os_id): False [ 1167.141677] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.141677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.141677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.141677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.141829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.141987] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.142147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.142147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.142353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.142998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.142998] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.142998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.142998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.142998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.142998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.143559] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.143674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.144235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.144235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.144235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.144235] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1167.148231] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.224907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.225890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.225890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.225890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.225890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.243436] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1167.657570] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.657570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.657570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.657570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.657570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.657570] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046b28ff-80bf-405a-859e-0080bd4c492a is going to be created. [ 1167.683813] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.683813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.683813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.683813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.683813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.695071] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046b28ff-80bf-405a-859e-0080bd4c492a in Status: UNINITIALIZED for 2s [ 1167.782180] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edd04021-574c-44b2-a8e2-86a06190f4c1 in Status: SUCCESS [ 1167.784459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.784459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.784459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.784459] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.784459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.784459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.784874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.784874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.785163] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.788420] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1167.788501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.788729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.788995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.789290] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.789543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.789640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.790095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.791198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.791198] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.294059] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.294059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.294059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.294059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.294059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.294631] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.294631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.294631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.294631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.294631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.294631] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd04021-574c-44b2-a8e2-86a06190f4c1 is going to be deleted. [ 1168.297078] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.335269] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.335474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.335611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.335697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.335790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.335892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.336054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.336511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.336511] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.336511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.336511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.337986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.337986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.337986] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.765529] env[65899]: INFO networking_nsxv3.common.synchronization [req-760fdfc0-3de7-48bd-ab55-733dd83c37a6 req-1320bff7-c199-4d11-ba20-ecb82aed3ad5 tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 1168.767312] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 1168.767312] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.767312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.767312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.767312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.767585] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.767683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.767919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.767989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.768099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.768193] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.803768] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.840939] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.841167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.841239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.842204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.842204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.842204] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.842204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.842204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.842204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.842204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.842620] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd04021-574c-44b2-a8e2-86a06190f4c1 already deleted. [ 1168.842620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.842620] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.844356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.844583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.845282] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.845282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.845282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.845282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.845464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.845578] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.262146] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1169.262597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.272929] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.272929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.272929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.272929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.292062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.292456] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.292719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.292879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.293168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.293343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.293513] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 is going to be updated. [ 1169.307519] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.307519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.307519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.307519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.307519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.307519] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be updated. [ 1169.346162] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edd04021-574c-44b2-a8e2-86a06190f4c1',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.348300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.348300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.348300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.348548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.349165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.349165] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.349307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.349307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.349557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.349688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.349885] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edd04021-574c-44b2-a8e2-86a06190f4c1 already deleted. [ 1169.349989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.351519] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.351585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.351672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.351923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.352146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.355693] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.356008] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.356133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.356386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.359361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.375272] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: IN_PROGRESS for 2s [ 1169.376075] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: IN_PROGRESS for 2s [ 1169.475067] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.475287] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.475398] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.475679] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.475942] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.476125] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.476371] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.476435] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.476573] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.476767] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.476905] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.480104] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.480104] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.480104] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.480104] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.480104] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.500047] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.500047] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.500047] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.500047] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.500047] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-986f83b3-fa67-4a39-82ae-14a7798d471f taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.500047] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.500047] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.500047] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.500702] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986f83b3-fa67-4a39-82ae-14a7798d471f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.717544] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046b28ff-80bf-405a-859e-0080bd4c492a in Status: SUCCESS [ 1169.717923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.718177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.718456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.718743] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.718872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.718963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.719322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.719465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.719619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.719770] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.848544] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edd04021-574c-44b2-a8e2-86a06190f4c1: rpc.has_security_group_logging(os_id): False [ 1169.999867] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.999867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.000165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.000224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.000303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.000566] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.000690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.000743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.000901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.000971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.001114] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edd04021-574c-44b2-a8e2-86a06190f4c1 is going to be created. [ 1170.002915] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.003129] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.003235] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.003484] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.003809] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.003809] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 986f83b3-fa67-4a39-82ae-14a7798d471f not found, creating... [ 1170.004044] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.004222] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.004287] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.004497] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.004631] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.005141] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.005399] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.005604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.006023] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.006263] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.006495] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 986f83b3-fa67-4a39-82ae-14a7798d471f is going to be created. [ 1170.049372] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/edd04021-574c-44b2-a8e2-86a06190f4c1], does not exist path=[/infra/domains/default/groups/edd04021-574c-44b2-a8e2-86a06190f4c1]."\n}' [ 1170.049532] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edd04021-574c-44b2-a8e2-86a06190f4c1 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/edd04021-574c-44b2-a8e2-86a06190f4c1 [ 1170.049532] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1170.051945] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.052199] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.052315] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.052575] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.052821] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.053057] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.189754] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.190162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.190162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.190301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.191421] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.191762] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.191877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.191969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.192194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.192281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.192508] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.192615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.192683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.192845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.192925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.193020] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edd04021-574c-44b2-a8e2-86a06190f4c1 is going to be created. [ 1170.222219] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-046b28ff-80bf-405a-859e-0080bd4c492a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.222534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.222534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.222832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.223066] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.223194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.223260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.223442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.223553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.223706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.223888] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-046b28ff-80bf-405a-859e-0080bd4c492a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.224168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.224261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.224446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.224639] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.224834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.224834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.224988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.225205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.225309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.225409] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.230784] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/edd04021-574c-44b2-a8e2-86a06190f4c1], does not exist path=[/infra/domains/default/groups/edd04021-574c-44b2-a8e2-86a06190f4c1]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/edd04021-574c-44b2-a8e2-86a06190f4c1 [ 1170.231096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edd04021-574c-44b2-a8e2-86a06190f4c1" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.232312] env[65899]: Traceback (most recent call last): [ 1170.232312] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1170.232312] env[65899]: return func(*args, **kwargs) [ 1170.232312] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1170.232312] env[65899]: res.raise_for_status() [ 1170.232312] env[65899]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1170.232312] env[65899]: raise HTTPError(http_error_msg, response=self) [ 1170.232312] env[65899]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/edd04021-574c-44b2-a8e2-86a06190f4c1 [ 1170.232312] env[65899]: During handling of the above exception, another exception occurred: [ 1170.232312] env[65899]: Traceback (most recent call last): [ 1170.232312] env[65899]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1170.232312] env[65899]: listener.cb(fileno) [ 1170.232312] env[65899]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1170.232312] env[65899]: result = function(*args, **kwargs) [ 1170.232312] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1170.232312] env[65899]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1170.232312] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1170.232312] env[65899]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1170.232312] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1170.232312] env[65899]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1170.232312] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1170.232312] env[65899]: res.raise_for_status() [ 1170.232312] env[65899]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1170.232312] env[65899]: raise HTTPError(http_error_msg, response=self) [ 1170.232312] env[65899]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/edd04021-574c-44b2-a8e2-86a06190f4c1 [ 1170.232312] env[65899]: Removing descriptor: 12 [ 1170.730384] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 046b28ff-80bf-405a-859e-0080bd4c492a: rpc.has_security_group_logging(os_id): False [ 1170.750095] env[65899]: INFO networking_nsxv3.common.synchronization [req-760fdfc0-3de7-48bd-ab55-733dd83c37a6 req-f2f5cf3d-bec9-4930-b1ad-78326a777702 service nova] Enqueued Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_rules [ 1170.750478] env[65899]: INFO networking_nsxv3.common.synchronization [req-760fdfc0-3de7-48bd-ab55-733dd83c37a6 req-f2f5cf3d-bec9-4930-b1ad-78326a777702 service nova] Enqueued Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 1170.752350] env[65899]: INFO networking_nsxv3.common.synchronization [req-760fdfc0-3de7-48bd-ab55-733dd83c37a6 req-f2f5cf3d-bec9-4930-b1ad-78326a777702 service nova] Enqueued Resource ID: 986f83b3-fa67-4a39-82ae-14a7798d471f with Priority: HIGHEST for action port [ 1170.752350] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.752350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.752350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.752656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.752656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.752834] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.752993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.752993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.753221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.753303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.754368] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.754463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.754528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.754718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.754926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.755040] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.755155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.755215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.755365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.755459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.755610] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 046b28ff-80bf-405a-859e-0080bd4c492a is going to be created. [ 1170.757134] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_rules [ 1170.757308] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 1170.757707] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986f83b3-fa67-4a39-82ae-14a7798d471f with Priority: HIGHEST for action port [ 1170.758046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.758137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.758202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.758407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.758476] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.759417] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.759511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.759705] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-986f83b3-fa67-4a39-82ae-14a7798d471f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.759802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.759863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.760027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.760300] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986f83b3-fa67-4a39-82ae-14a7798d471f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.835271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.835271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.835271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.835271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.835271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.853587] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 046b28ff-80bf-405a-859e-0080bd4c492a in Status: IN_PROGRESS for 2s [ 1171.262601] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 986f83b3-fa67-4a39-82ae-14a7798d471f with status ACTIVE [ 1171.262928] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.263132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.263452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.263784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.264018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.264278] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.264407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.264569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.265093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.265196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.265434] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.265587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.265678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.265883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.265998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.266143] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 986f83b3-fa67-4a39-82ae-14a7798d471f is going to be updated. [ 1171.267482] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.267573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.289118] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.289353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.289418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.289631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.289766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.289921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.341142] env[65899]: INFO networking_nsxv3.common.synchronization [req-eba0a05b-bada-4d5e-80db-1e427e08afa2 req-600ab52a-6f31-4787-8f5e-8228dd30f10a tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1171.341142] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1171.341142] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.341436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.341576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.341843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.342152] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.342357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.342489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.342705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.342862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.343038] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.388486] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1171.388486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.388486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.388486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.388486] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.388486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.388486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.388486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.388486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.388813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.388813] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.390306] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: SUCCESS [ 1171.390474] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 deletion is rescheduled due to dependency. [ 1171.390570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.390714] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.390959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.391151] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.391529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.391529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.391529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.391529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.391662] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.392629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.392890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.392962] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.393827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.393931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.396768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.397107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.399347] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.400965] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.474247] env[65899]: INFO networking_nsxv3.common.synchronization [req-a2644738-3353-4ed1-9300-1541d0531627 req-2c181148-062d-4f91-8b56-e2c5b0289cce tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1171.474435] env[65899]: INFO networking_nsxv3.common.synchronization [req-a2644738-3353-4ed1-9300-1541d0531627 req-2c181148-062d-4f91-8b56-e2c5b0289cce tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1171.475331] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1171.478545] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1171.478902] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.479049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.479144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.479433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.479607] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.479710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.479770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.479927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.480023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.480120] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.481427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.481597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.481693] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.482045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.483146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.483916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.483916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.483916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.484098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.484803] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.521921] env[65899]: INFO networking_nsxv3.common.synchronization [req-a2644738-3353-4ed1-9300-1541d0531627 req-2c181148-062d-4f91-8b56-e2c5b0289cce tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1171.522114] env[65899]: INFO networking_nsxv3.common.synchronization [req-a2644738-3353-4ed1-9300-1541d0531627 req-2c181148-062d-4f91-8b56-e2c5b0289cce tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1171.522248] env[65899]: INFO networking_nsxv3.common.synchronization [req-a2644738-3353-4ed1-9300-1541d0531627 req-2c181148-062d-4f91-8b56-e2c5b0289cce tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_rules [ 1171.522373] env[65899]: INFO networking_nsxv3.common.synchronization [req-a2644738-3353-4ed1-9300-1541d0531627 req-2c181148-062d-4f91-8b56-e2c5b0289cce tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1171.522494] env[65899]: INFO networking_nsxv3.common.synchronization [req-a2644738-3353-4ed1-9300-1541d0531627 req-2c181148-062d-4f91-8b56-e2c5b0289cce tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 with Priority: HIGHEST for action port [ 1171.522956] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1171.523108] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_rules [ 1171.523202] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 with Priority: HIGHEST for action port [ 1171.523292] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1171.523376] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1171.523640] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.523757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.523821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.524158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.524264] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.525271] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.525437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.525484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.525784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.525881] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.527083] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-912c1ccf-0381-41cf-b896-f3dfc18c1223 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.527134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.527279] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.527469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.527546] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912c1ccf-0381-41cf-b896-f3dfc18c1223',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.528555] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.528647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.528832] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.528914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.714640] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.714640] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.714640] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.714640] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.714640] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.715092] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.715092] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.715748] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.716384] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.716384] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.716384] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1171.716384] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1171.716555] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1171.716584] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1171.716692] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1171.716849] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1171.734910] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1171.735209] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1171.735293] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1171.735397] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.735705] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-1f640ad2-62e5-4647-9095-23b19e6917eb taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.735878] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-1f640ad2-62e5-4647-9095-23b19e6917eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.735999] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-1f640ad2-62e5-4647-9095-23b19e6917eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.736349] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-1f640ad2-62e5-4647-9095-23b19e6917eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.736661] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f640ad2-62e5-4647-9095-23b19e6917eb',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.845994] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.845994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.845994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.846262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.870631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.870907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.871043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.871132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.871358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.871534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.871634] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1171.903023] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.903023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.903023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.903023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.903023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.904173] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.904287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.905039] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.905419] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.917040] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1171.986742] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.987942] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.028259] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.028259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.031552] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 912c1ccf-0381-41cf-b896-f3dfc18c1223 with status ACTIVE [ 1172.031552] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.031552] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.031552] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.031552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.031552] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 is going to be updated. [ 1172.032542] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.032634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.052652] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.052833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.052833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.053114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.053327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.053571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.240331] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.240563] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.240689] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.240979] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.241143] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.241300] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 1f640ad2-62e5-4647-9095-23b19e6917eb not found, creating... [ 1172.241575] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.241731] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.241858] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.242086] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.242250] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.242513] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.242676] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.242828] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.243067] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.243255] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.243429] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 1f640ad2-62e5-4647-9095-23b19e6917eb is going to be created. [ 1172.270112] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.270648] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.270648] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.273772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.273772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.273772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-1f640ad2-62e5-4647-9095-23b19e6917eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.406789] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.408668] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.408813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.408813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.409966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.409966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.409966] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be updated. [ 1172.457862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.458066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.458110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.458308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.458457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.476508] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: IN_PROGRESS for 2s [ 1172.491594] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.492691] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.871614] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 046b28ff-80bf-405a-859e-0080bd4c492a in Status: SUCCESS [ 1172.871947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.912668] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.913218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.913304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.913548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.913608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.913708] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 is going to be updated. [ 1172.962726] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.963113] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.963227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.963548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.963778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.977690] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: IN_PROGRESS for 2s [ 1172.995906] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.996331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.996420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.996624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.996733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.996910] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e is going to be created. [ 1172.998704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.998818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.998907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.999197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.999809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.999809] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1173.030563] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.030951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.030951] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.031101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.031305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.036107] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.036300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.036394] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.036587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.036908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.042724] env[65899]: INFO networking_nsxv3.common.synchronization [req-eba0a05b-bada-4d5e-80db-1e427e08afa2 req-e5359dee-c741-470e-9fd7-08791f943976 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1173.042944] env[65899]: INFO networking_nsxv3.common.synchronization [req-eba0a05b-bada-4d5e-80db-1e427e08afa2 req-e5359dee-c741-470e-9fd7-08791f943976 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1173.043113] env[65899]: INFO networking_nsxv3.common.synchronization [req-eba0a05b-bada-4d5e-80db-1e427e08afa2 req-e5359dee-c741-470e-9fd7-08791f943976 service nova] Enqueued Resource ID: 1f640ad2-62e5-4647-9095-23b19e6917eb with Priority: HIGHEST for action port [ 1173.044340] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: UNINITIALIZED for 2s [ 1173.044879] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1173.045067] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1173.045185] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f640ad2-62e5-4647-9095-23b19e6917eb with Priority: HIGHEST for action port [ 1173.045506] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.045645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.045711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.045956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.046193] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.047946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.050848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.050848] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f640ad2-62e5-4647-9095-23b19e6917eb taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.050848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f640ad2-62e5-4647-9095-23b19e6917eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.050848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f640ad2-62e5-4647-9095-23b19e6917eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.050848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f640ad2-62e5-4647-9095-23b19e6917eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.050848] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f640ad2-62e5-4647-9095-23b19e6917eb',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.050848] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1173.480462] env[65899]: INFO networking_nsxv3.common.synchronization [req-c56d0ab3-6f26-41cc-80b9-7492165ddbff req-11b950a4-cd18-4636-8ba0-abe58155c53a tempest-ServerRescueTestJSONUnderV235-424025521 tempest-ServerRescueTestJSONUnderV235-424025521-project-member] Enqueued Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1173.481210] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa with Priority: HIGHEST for action security_group_members [ 1173.481644] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.481756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.551877] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.551877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.555552] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f640ad2-62e5-4647-9095-23b19e6917eb with status ACTIVE [ 1173.555694] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.555846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.555918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.556139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.556229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.556418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.556515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.556589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.556738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.556817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.557038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.557144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.557207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.557704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.557704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.557704] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f640ad2-62e5-4647-9095-23b19e6917eb is going to be updated. [ 1173.565756] env[65899]: INFO networking_nsxv3.common.synchronization [req-af94d310-28da-43de-953f-0fe67e2cf9b3 req-e246544e-a602-4027-b251-c2d1b9696b04 tempest-ServerActionsTestOtherB-1521776614 tempest-ServerActionsTestOtherB-1521776614-project-member] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1173.566674] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1173.572917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.572917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.572917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.572917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.572917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.572917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.572917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.572917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.572917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.572917] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.589089] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.589231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.589306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.589494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.589623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.591019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f640ad2-62e5-4647-9095-23b19e6917eb" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.932784] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1173.933196] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1173.933196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.933259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.933464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.933746] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.933910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.933972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.935693] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.935693] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.935693] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.077275] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.077461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.077562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.077752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.102466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.102751] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.102874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.102935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.103450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.103450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.103450] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1174.131611] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.131859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.131859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.132110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.132261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.142368] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1174.419538] env[65899]: INFO networking_nsxv3.common.synchronization [req-23e93923-d280-4977-bf72-b69746ddf6e1 req-8b1a665c-1ab1-4b0e-92bd-5387dc4a1899 tempest-ServerRescueNegativeTestJSON-46823991 tempest-ServerRescueNegativeTestJSON-46823991-project-member] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 1174.420326] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 1174.420444] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.420566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.420628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.420823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.420973] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.424208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.424208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.424398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.424966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.424966] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.439267] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.490066] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1174.490179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.490626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.490852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.491051] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.491212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.491266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.491371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.491463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.491535] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.929093] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.945157] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.991256] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: SUCCESS [ 1174.991579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.991709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.991944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.992248] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.992432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.992686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.992790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.992928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.993069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.993196] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.996511] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.996661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.996768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.997028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.028668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.028962] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.029120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.029192] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.029408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.029493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.029588] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be updated. [ 1175.057595] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: SUCCESS [ 1175.057887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.058030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.058236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.058443] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.058561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.058628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.058795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.058877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.058987] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.060502] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1175.060679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.060823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.060993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.061178] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.061281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.061344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.061480] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.061555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.061640] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.070321] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.070452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.070525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.070752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.070884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.080344] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: IN_PROGRESS for 2s [ 1175.433658] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.447095] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.447351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.447351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.447595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.447692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.447856] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1175.490190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.490393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.490491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.490750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.490935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.497824] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.497824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.497824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.497824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.497824] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.498424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.498424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.498424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.498552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.500196] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.500196] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.500196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.500196] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.503344] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1175.564374] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.565742] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.936694] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.936875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.937029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.937259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.937349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.937448] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be updated. [ 1175.972701] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.972990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.973133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.973460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.973815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.987120] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: IN_PROGRESS for 2s [ 1176.003150] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7823ce5a-b26b-47ed-b253-093353398a68: rpc.has_security_group_logging(os_id): False [ 1176.026946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.027139] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.027492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.027492] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.054918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.055192] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.055312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.055614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.055614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.055749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.055845] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.055942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.056018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.056170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.056245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.056444] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.056532] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.056591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.056729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.056801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.056914] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 is going to be updated. [ 1176.068184] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.073378] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.124927] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.125151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.125216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.125464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.125616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.141176] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: IN_PROGRESS for 2s [ 1176.147197] env[65899]: INFO networking_nsxv3.common.synchronization [req-5faf3ce7-a90f-4c06-834e-a46079bd90e0 req-09159e93-27f9-453d-999a-b9ded659b698 tempest-ServersAdminTestJSON-2084545516 tempest-ServersAdminTestJSON-2084545516-project-member] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1176.148901] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGHEST for action security_group_members [ 1176.149315] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.149556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.149716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.150065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.150391] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.150610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.150847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.152872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.152872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.152872] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.157287] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1176.159321] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 deletion is rescheduled due to dependency. [ 1176.159321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.577185] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.577185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.577185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.577185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.577185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.577185] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e is going to be updated. [ 1176.578442] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.578610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.579493] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.580074] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.580074] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.580074] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1176.643198] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.643307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.643389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.646339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.646339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.646736] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.646736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.646971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.647235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.647379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.658832] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.658995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.659221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.659484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.661321] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: IN_PROGRESS for 2s [ 1176.662326] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1176.685560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.685560] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.685560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.685560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.685560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.685560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.685560] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be updated. [ 1176.738314] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.738390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.738452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.738674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.738801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.751141] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: IN_PROGRESS for 2s [ 1177.097627] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1177.098040] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa deletion is rescheduled due to dependency. [ 1177.098040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.098132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.098324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.098517] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.098626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.098689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.098837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.098916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.099012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.099175] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.099354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.099897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.100862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.101894] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.102293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.102629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.102811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.102900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.102993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.103121] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.104052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.104230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.104406] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.104508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.104569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.104840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.104964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.105081] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.513927] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1177.514208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.514381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.514634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.514934] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.515269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.515269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.515408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.515437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.515532] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.515623] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.606744] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5fc4719-ed06-40a1-9606-7c4ebb5340aa: rpc.has_security_group_logging(os_id): False [ 1177.608445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.608611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.608611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.608829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.608893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.609078] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.609197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.609256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.609417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.609491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.609579] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be updated. [ 1177.632142] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.632374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.632504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.632794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.633054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.633391] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.633533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.633606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.633872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.634142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.634399] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.634559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.634653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.634999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.635204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.635503] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.635734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.635853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.636233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.636346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.636500] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be updated. [ 1177.643913] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.644118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.644211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.644501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.644635] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.661930] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: IN_PROGRESS for 2s [ 1177.726042] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.726042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.726042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.726258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.726683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.748060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: IN_PROGRESS for 2s [ 1177.998966] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: SUCCESS [ 1177.998966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.018783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.018934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.019091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.019253] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.019533] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.019533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.019647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.019771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.019861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.019946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.020113] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.020217] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.020281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.020466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.020553] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.020644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.020715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.020863] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.020930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.021099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.021178] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.124792] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.125108] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.125604] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.125887] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.126176] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.126360] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.126478] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.126699] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.126838] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.127106] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.127221] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.127328] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.127604] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.127604] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.127815] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.127815] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.148952] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.149142] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.149303] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.149484] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.149796] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-1f802cc3-6336-4eb2-a623-2a229d168000 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.149973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.150178] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.150502] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.150668] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f802cc3-6336-4eb2-a623-2a229d168000',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.152229] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: SUCCESS [ 1178.152422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.523549] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3990baf0-9e24-4b70-8c31-60cf273fe344: rpc.has_security_group_logging(os_id): False [ 1178.541108] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.541325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.541438] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.541732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.541870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.542135] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.542293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.542410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.542631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.542758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.543020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.543188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.543297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.543500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.543621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.543870] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.544029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.544134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.544324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.544456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.544591] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1178.614746] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.614746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.614746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.614746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.614983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.626937] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1178.654362] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.654544] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.654596] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.654939] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.655157] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.655310] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 1f802cc3-6336-4eb2-a623-2a229d168000 not found, creating... [ 1178.655597] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.655765] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.655882] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.656462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.656462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.656622] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.656795] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.656998] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.657908] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.658073] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.658540] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 1f802cc3-6336-4eb2-a623-2a229d168000 is going to be created. [ 1178.678860] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: SUCCESS [ 1178.678860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.678860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.679125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.679262] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.679362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.679362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.679560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.679637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.679719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.679840] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.681689] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1178.681689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.681850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.682053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.682303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.682376] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.683290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.683290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.683290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.683290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.683290] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.690194] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.690416] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.690547] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.691028] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.691100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.691305] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.774856] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 in Status: SUCCESS [ 1178.775068] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 deletion is rescheduled due to dependency. [ 1178.775182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.187309] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.188888] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.189096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.189210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.189507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.189727] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.189843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.189904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.192592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.192823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.194037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.194037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.194037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.194037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.194037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.194037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.194037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.194037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.194487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.194487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.194487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.194621] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.460997] env[65899]: INFO networking_nsxv3.common.synchronization [req-35f2a686-559b-4878-9a53-911f3b5ff87b req-645ab3f8-6c5b-4fac-a157-fb7d3e9ec25b service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 1179.460997] env[65899]: INFO networking_nsxv3.common.synchronization [req-35f2a686-559b-4878-9a53-911f3b5ff87b req-645ab3f8-6c5b-4fac-a157-fb7d3e9ec25b service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1179.460997] env[65899]: INFO networking_nsxv3.common.synchronization [req-35f2a686-559b-4878-9a53-911f3b5ff87b req-645ab3f8-6c5b-4fac-a157-fb7d3e9ec25b service nova] Enqueued Resource ID: 1f802cc3-6336-4eb2-a623-2a229d168000 with Priority: HIGHEST for action port [ 1179.461668] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 1179.461879] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1179.462566] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f802cc3-6336-4eb2-a623-2a229d168000 with Priority: HIGHEST for action port [ 1179.462566] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.462794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.462794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.463641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.463641] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.464296] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.464599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.464695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.464942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.465167] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.465329] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.465631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.465631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.466092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.466219] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.467388] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f802cc3-6336-4eb2-a623-2a229d168000 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.467388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.467388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.469930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.469930] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f802cc3-6336-4eb2-a623-2a229d168000',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.674763] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1179.674763] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa deletion is rescheduled due to dependency. [ 1179.674763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.700208] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e: rpc.has_security_group_logging(os_id): False [ 1179.700208] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10e0d2a4-e42f-49c4-b693-268f72e54b08: rpc.has_security_group_logging(os_id): False [ 1179.724034] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.724034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.724034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.724034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.724753] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.724982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.748021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.748021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.748021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.748021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.748570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.748570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.748570] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1179.749561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.749904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.750093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.750443] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.750696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.750836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.751097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.751322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.751551] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e is going to be created. [ 1179.778236] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa in Status: SUCCESS [ 1179.778236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.778425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.778603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.778690] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5fc4719-ed06-40a1-9606-7c4ebb5340aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.837404] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.837613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.837613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.838260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.838456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.848599] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.848786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.848843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.849017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.849198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.851393] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: IN_PROGRESS for 2s [ 1179.859370] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1179.859525] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 with Priority: HIGHEST for action security_group_members [ 1179.859661] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1179.860351] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1179.860487] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 with Priority: HIGHEST for action security_group_members [ 1179.860585] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1179.860991] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.860991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.861092] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.861352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.861413] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.861461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.861522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.861668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.861752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.861824] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.862643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff67b975-63bb-46a9-9e9f-3520ebe92b40 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.862746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.863677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.863677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.863677] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.863677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.863677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.863677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.863677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.863677] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.864309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.865218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.865218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.865218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.865218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.865218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.865218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.865218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.865218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.865218] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.870550] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1179.912959] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1179.913161] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1179.913361] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_rules [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 with Priority: HIGHEST for action security_group_rules [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 with Priority: HIGHEST for action security_group_members [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b9b2618-c64e-460f-95da-d012ec736323 req-3f443e66-e97e-47c5-a1c6-1004222583b8 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 with Priority: HIGHEST for action port [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_rules [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_rules [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 with Priority: HIGHEST for action security_group_members [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 with Priority: HIGHEST for action port [ 1179.915556] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 with Priority: HIGHEST for action security_group_rules [ 1179.916035] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1179.917224] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1179.917224] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.917224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.917594] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.917709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.918554] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff67b975-63bb-46a9-9e9f-3520ebe92b40 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.918554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.918554] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-912c1ccf-0381-41cf-b896-f3dfc18c1223 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.918554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.918554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.920900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.920900] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912c1ccf-0381-41cf-b896-f3dfc18c1223',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.921763] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff67b975-63bb-46a9-9e9f-3520ebe92b40 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.921763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.921763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.921978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.922044] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.923801] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.923801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.923801] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.923801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.971316] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.971316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.971547] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.973106] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f802cc3-6336-4eb2-a623-2a229d168000 with status ACTIVE [ 1179.973324] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.973458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.973566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.975569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.975569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.975569] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.975569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.975569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.975569] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.975862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.976034] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.976126] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.976187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.979865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.979865] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.979865] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f802cc3-6336-4eb2-a623-2a229d168000 is going to be updated. [ 1180.027334] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.027760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.027929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.028228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.028488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.028803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.299791] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.300278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.300278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.300278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.300479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.300546] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5fc4719-ed06-40a1-9606-7c4ebb5340aa is going to be deleted. [ 1180.351179] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.351339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.351393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.351604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.351735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.351956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5fc4719-ed06-40a1-9606-7c4ebb5340aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.366503] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.367769] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.368758] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.421488] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 912c1ccf-0381-41cf-b896-f3dfc18c1223 with status ACTIVE [ 1180.422977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.422977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.422977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.422977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.422977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.422977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.422977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.422977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.423437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.423437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.423497] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.423601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.423676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.423837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.423902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.424051] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 912c1ccf-0381-41cf-b896-f3dfc18c1223 is going to be updated. [ 1180.425720] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff67b975-63bb-46a9-9e9f-3520ebe92b40 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.425845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.457692] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.458146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.458625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.458625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.458723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.458914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-912c1ccf-0381-41cf-b896-f3dfc18c1223" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.482412] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.639194] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1180.639556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.869971] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.871407] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.872415] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.936279] env[65899]: INFO networking_nsxv3.common.synchronization [None req-d4b32305-14da-449e-b041-a34ecbb25878 tempest-AttachVolumeTestJSON-2123047702 tempest-AttachVolumeTestJSON-2123047702-project-member] Enqueued Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_rules [ 1180.936279] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_rules [ 1180.936279] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17851c9-16c9-44ea-b660-c316b983e92e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.936279] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.936279] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.936913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.937235] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.985677] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.985918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.986056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.986622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.986622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.986622] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be created. [ 1181.014506] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.014731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.014840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.015144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.015383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.032102] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: UNINITIALIZED for 2s [ 1181.084566] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3da869f0-2a9d-46f6-ac70-02a9d90c2684 tempest-AttachVolumeTestJSON-2123047702 tempest-AttachVolumeTestJSON-2123047702-project-member] Enqueued Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_rules [ 1181.085487] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_rules [ 1181.089365] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17851c9-16c9-44ea-b660-c316b983e92e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.089365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.372937] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.373262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.373262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.373392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.373434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.373560] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1181.377664] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.377821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.377910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.378146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.378245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.378345] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e is going to be updated. [ 1181.379647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.379765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.379825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.380035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.380132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.380195] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 is going to be created. [ 1181.409749] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.409912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.410010] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.410670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.410670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.413128] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.413472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.413571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.413781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.413934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.415721] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.415871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.415941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.416168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.416331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.427957] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1181.429086] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 in Status: UNINITIALIZED for 2s [ 1181.429725] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: IN_PROGRESS for 2s [ 1181.464803] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.464803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.464803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.464803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.464803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.464803] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17851c9-16c9-44ea-b660-c316b983e92e already deleted. [ 1181.464803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.465257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.465316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.465457] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.878190] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: SUCCESS [ 1181.878487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.878724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.879099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.879300] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.887381] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1181.887381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.887684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.887780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.887878] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.989771] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.989771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.989771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.989771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.989771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.989771] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17851c9-16c9-44ea-b660-c316b983e92e already deleted. [ 1181.989771] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.383398] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.383787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.389979] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.390123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.044629] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1183.045061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.045138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.045333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.045530] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.045692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.045770] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.045904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.046065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.046065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.046153] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.419323] env[65899]: INFO networking_nsxv3.common.synchronization [req-901b5ae5-0c36-49b0-8ae1-9fc5bae8e992 req-51a00b9e-75c4-4a56-8b3c-d50ff3f007c4 tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 1183.420219] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7823ce5a-b26b-47ed-b253-093353398a68 with Priority: HIGHEST for action security_group_members [ 1183.420689] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-7823ce5a-b26b-47ed-b253-093353398a68 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.421055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.421055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.421283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.421507] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.421794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.421924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.422188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.422335] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.422476] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7823ce5a-b26b-47ed-b253-093353398a68',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.443600] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: SUCCESS [ 1183.443898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.444948] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 in Status: SUCCESS [ 1183.445890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.446124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.446506] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.446780] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.446944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.447177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.447429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.447534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.447664] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.448712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.448956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.449216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.449396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.449441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.449653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.449775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.449888] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.451913] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1183.452104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.452730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.452862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.453097] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.453243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.453333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.453561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.453676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.454033] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.476913] env[65899]: INFO networking_nsxv3.common.synchronization [req-901b5ae5-0c36-49b0-8ae1-9fc5bae8e992 req-51a00b9e-75c4-4a56-8b3c-d50ff3f007c4 tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 986f83b3-fa67-4a39-82ae-14a7798d471f with Priority: HIGHEST for action port [ 1183.477744] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986f83b3-fa67-4a39-82ae-14a7798d471f with Priority: HIGHEST for action port [ 1183.478139] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-986f83b3-fa67-4a39-82ae-14a7798d471f taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.478278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.478345] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.478549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.478629] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986f83b3-fa67-4a39-82ae-14a7798d471f',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.551228] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.551228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.551460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.551857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.551857] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.551857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.552059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.552059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.552180] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.552276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.552448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.552579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.552733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.552790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.552931] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.553035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.553098] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.553235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.553308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.553387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.553474] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.925061] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.925228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.925360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.925607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.925706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.926030] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.926130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.926204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.926343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.926469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.926535] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 is going to be updated. [ 1183.952450] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.956712] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.958417] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.958542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.958542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.958922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.959104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.960211] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.971443] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: IN_PROGRESS for 2s [ 1183.980700] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 986f83b3-fa67-4a39-82ae-14a7798d471f with status ACTIVE [ 1183.980933] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.981081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.981176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.981357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.981439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.981618] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.981728] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.981786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.981903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.981971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.982163] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.982257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.982310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.982441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.982521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.982573] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 986f83b3-fa67-4a39-82ae-14a7798d471f is going to be updated. [ 1184.010105] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.010105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.010443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.010443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.010558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.010726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-986f83b3-fa67-4a39-82ae-14a7798d471f" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.056422] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b339ac-01aa-4f28-9e73-9f48477e571d: rpc.has_security_group_logging(os_id): False [ 1184.076322] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.076509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.076554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.076741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.076822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.077083] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.077199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.077267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.077408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.077484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.077760] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.077760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.077882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.077966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.078030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.078217] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.078358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.078358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.078500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.078570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.078652] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be created. [ 1184.166827] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.166945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.167112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.167326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.167597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.186752] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1184.455217] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.462604] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.463390] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.957719] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.957959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.958132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.958419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.958572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.958752] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e is going to be updated. [ 1184.965456] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.965624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.965987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.966504] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.967127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.967805] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 is going to be updated. [ 1184.969026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.972637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.972768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.972940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.973052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.973164] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1184.994417] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.994417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.994417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.994705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.994824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.006152] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.006461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.006514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.006854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.007834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.009870] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: IN_PROGRESS for 2s [ 1185.010803] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.010953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.011065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.011332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.011522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.020728] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 in Status: IN_PROGRESS for 2s [ 1185.021631] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1185.508545] env[65899]: INFO networking_nsxv3.common.synchronization [req-9847f373-1854-48cc-9e61-6bd8a921b90b req-51db11dc-b034-40a4-9719-36e7430a0809 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 with Priority: HIGHEST for action security_group_members [ 1185.508776] env[65899]: INFO networking_nsxv3.common.synchronization [req-9847f373-1854-48cc-9e61-6bd8a921b90b req-51db11dc-b034-40a4-9719-36e7430a0809 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1185.508816] env[65899]: INFO networking_nsxv3.common.synchronization [req-9847f373-1854-48cc-9e61-6bd8a921b90b req-51db11dc-b034-40a4-9719-36e7430a0809 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1185.509421] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 with Priority: HIGHEST for action security_group_members [ 1185.509568] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1185.509666] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e with Priority: HIGHEST for action security_group_members [ 1185.510747] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff67b975-63bb-46a9-9e9f-3520ebe92b40 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.510747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.511208] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.511380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.511757] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.511937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.986459] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7823ce5a-b26b-47ed-b253-093353398a68 in Status: SUCCESS [ 1185.986459] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7823ce5a-b26b-47ed-b253-093353398a68 deletion is rescheduled due to dependency. [ 1185.986459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7823ce5a-b26b-47ed-b253-093353398a68" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.124106] env[65899]: INFO networking_nsxv3.common.synchronization [req-1174b91f-397c-4e77-81c1-240af70762d8 req-7e413ab4-bf76-41c6-a957-7a6170ef5cb9 tempest-InstanceActionsTestJSON-654101570 tempest-InstanceActionsTestJSON-654101570-project-member] Enqueued Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGHEST for action security_group_members [ 1186.124641] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGHEST for action security_group_members [ 1186.124953] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-046b28ff-80bf-405a-859e-0080bd4c492a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.126227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.126327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.126540] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.127170] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.127515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.127515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.127515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.127716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.127716] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.201677] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1186.201849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.633215] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.635642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.635769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.636032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.636132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.636357] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.636462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.636524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.636676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.636752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.636838] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046b28ff-80bf-405a-859e-0080bd4c492a is going to be updated. [ 1186.670515] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.670659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.670746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.670938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.671096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.681740] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046b28ff-80bf-405a-859e-0080bd4c492a in Status: IN_PROGRESS for 2s [ 1187.022682] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: SUCCESS [ 1187.022937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.024845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.025194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.025466] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.025550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.025585] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.025750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.025808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.025905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.026064] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.026917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.027135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.027327] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.027566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.027566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.027654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.027724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.027869] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.038719] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1187.038792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.039382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.039382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.039575] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.039575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.039717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.039788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.039846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.040523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.041088] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.043575] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 in Status: SUCCESS [ 1187.043575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.043575] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.043837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.044039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.044246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.044246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.044604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.044604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.044604] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.045786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.046102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.046160] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.046844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.046844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.046844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.046844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.046844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.046844] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.051811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.051995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.052194] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.052559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.052559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.052559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.052698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.052698] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.529757] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e1cfb97-2b8b-4c03-b3bb-d47979f0434e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.530952] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.531133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.531210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.531404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.531491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.531675] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.531782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.531843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.531985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.532075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.532161] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e is going to be updated. [ 1187.549613] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.550156] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.554803] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.555818] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff67b975-63bb-46a9-9e9f-3520ebe92b40',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.556685] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.556838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.556907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.557171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.557257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.557464] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.557567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.557629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.561226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.561375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.561523] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 is going to be deleted. [ 1187.576501] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.576501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.576501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.576501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.576501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.593969] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: IN_PROGRESS for 2s [ 1187.602912] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.602912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.602912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.603168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.603271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.603356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.785301] env[65899]: INFO networking_nsxv3.common.synchronization [req-1d8a5385-d8cc-4535-8bb6-572f06d089db req-a1111047-e389-4306-8f5a-7c65da69dbeb tempest-ServerRescueNegativeTestJSON-46823991 tempest-ServerRescueNegativeTestJSON-46823991-project-member] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 1187.786456] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGHEST for action security_group_members [ 1187.786737] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.786737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.786826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.787618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.787618] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.787618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.787618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.788390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.788390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.788390] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.023889] env[65899]: INFO networking_nsxv3.common.synchronization [req-f6ff4f66-d50b-4cd8-9e6d-a7b94042ce8b req-33d4e380-2ddf-40c3-a4b3-3abeec674d21 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1188.024544] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1188.024880] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.025021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.025932] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.026196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.026696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.026831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.026903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.027172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.027361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.027361] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.035371] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e: rpc.has_security_group_logging(os_id): False [ 1188.058418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.058418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.058418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.058418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.058418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.058418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.058418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.058418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.058418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.058418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.059060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e is going to be updated. [ 1188.064137] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff67b975-63bb-46a9-9e9f-3520ebe92b40: rpc.has_security_group_logging(os_id): False [ 1188.065657] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.084935] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.085222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.085310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.085523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.085613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.085846] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.085947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.086014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.086171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.086246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.086332] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 is going to be created. [ 1188.106570] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ff67b975-63bb-46a9-9e9f-3520ebe92b40], does not exist path=[/infra/domains/default/groups/ff67b975-63bb-46a9-9e9f-3520ebe92b40]."\n}' [ 1188.106802] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ff67b975-63bb-46a9-9e9f-3520ebe92b40 [ 1188.106918] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1188.156044] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.156304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.156304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.157601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.157736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.158014] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.158286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.158356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.158561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.158648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.159799] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.159799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.159799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.159799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.159799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.159799] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff67b975-63bb-46a9-9e9f-3520ebe92b40 is going to be created. [ 1188.179479] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.179648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.179734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.180053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.180478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.182243] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/ff67b975-63bb-46a9-9e9f-3520ebe92b40], does not exist path=[/infra/domains/default/groups/ff67b975-63bb-46a9-9e9f-3520ebe92b40]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ff67b975-63bb-46a9-9e9f-3520ebe92b40 [ 1188.182342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff67b975-63bb-46a9-9e9f-3520ebe92b40" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.182511] env[65899]: Traceback (most recent call last): [ 1188.182576] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1188.182576] env[65899]: return func(*args, **kwargs) [ 1188.182576] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1188.182576] env[65899]: res.raise_for_status() [ 1188.182576] env[65899]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1188.182576] env[65899]: raise HTTPError(http_error_msg, response=self) [ 1188.182576] env[65899]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ff67b975-63bb-46a9-9e9f-3520ebe92b40 [ 1188.182576] env[65899]: During handling of the above exception, another exception occurred: [ 1188.182576] env[65899]: Traceback (most recent call last): [ 1188.182576] env[65899]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1188.182576] env[65899]: listener.cb(fileno) [ 1188.182576] env[65899]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1188.182576] env[65899]: result = function(*args, **kwargs) [ 1188.182576] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1188.182576] env[65899]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1188.182576] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1188.182576] env[65899]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1188.182576] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1188.182576] env[65899]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1188.182576] env[65899]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1188.182576] env[65899]: res.raise_for_status() [ 1188.182576] env[65899]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1188.182576] env[65899]: raise HTTPError(http_error_msg, response=self) [ 1188.182576] env[65899]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/ff67b975-63bb-46a9-9e9f-3520ebe92b40 [ 1188.182576] env[65899]: Removing descriptor: 58 [ 1188.196223] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: IN_PROGRESS for 2s [ 1188.293643] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.293972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.293972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.294204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.319637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.320012] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.320161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.320161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.321030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.321030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.321030] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be updated. [ 1188.362837] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.363057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.363057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.363324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.363473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.373522] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: IN_PROGRESS for 2s [ 1188.520271] env[65899]: INFO networking_nsxv3.common.synchronization [req-e8e422e3-cdec-4e4f-acca-31613a9840ca req-9923c39e-7fa3-4fd4-9588-02b1a8d9d54e tempest-AttachVolumeTestJSON-2123047702 tempest-AttachVolumeTestJSON-2123047702-project-member] Enqueued Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_members [ 1188.521152] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_members [ 1188.521652] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17851c9-16c9-44ea-b660-c316b983e92e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.522022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.524071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.524071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.524071] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.524071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.524071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.524071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.524071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.524071] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.531045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.531045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.531045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.531045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.552436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.552739] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.552963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.552963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.553170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.553220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.553307] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1188.569625] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.569967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.570225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.570532] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.570940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.570940] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1188.593570] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.593809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.593915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.594244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.594479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.609242] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1188.610225] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.610373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.610436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.610648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.610784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.620309] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1188.696069] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046b28ff-80bf-405a-859e-0080bd4c492a in Status: SUCCESS [ 1188.696069] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046b28ff-80bf-405a-859e-0080bd4c492a deletion is rescheduled due to dependency. [ 1188.696069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.954436] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.954757] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-586" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.954757] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-586" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.955013] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-586" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.956411] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.956783] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.957060] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.957557] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.960314] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.960314] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.960314] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.960314] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.960314] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.960314] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.960314] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.960314] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.983976] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.984111] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1188.985128] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.985128] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-586" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.985128] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.985443] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.985443] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.986437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.986437] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a9136d7-a6e1-4431-89dd-8a0d8d5e9210',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.028809] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.029056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.029056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.029266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.029373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.029575] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.030323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.030323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.030323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.030323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.030323] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17851c9-16c9-44ea-b660-c316b983e92e already deleted. [ 1189.030323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.489027] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.489307] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.489546] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.489962] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.490233] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.490493] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 9a9136d7-a6e1-4431-89dd-8a0d8d5e9210 not found, creating... [ 1189.490955] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.491363] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.491575] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.491945] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.492202] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.492676] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.492941] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.493180] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.493531] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.493765] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.494016] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 9a9136d7-a6e1-4431-89dd-8a0d8d5e9210 is going to be created. [ 1189.516313] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.516526] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.516832] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.516923] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.517263] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.517494] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.606299] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: SUCCESS [ 1189.606519] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e deletion is rescheduled due to dependency. [ 1189.606953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.213996] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e1cfb97-2b8b-4c03-b3bb-d47979f0434e in Status: SUCCESS [ 1190.214255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e1cfb97-2b8b-4c03-b3bb-d47979f0434e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.256054] env[65899]: INFO networking_nsxv3.common.synchronization [req-e8e422e3-cdec-4e4f-acca-31613a9840ca req-3089e8c0-d141-4a06-afae-f5358ea08a5b service nova] Enqueued Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_rules [ 1190.256339] env[65899]: INFO networking_nsxv3.common.synchronization [req-e8e422e3-cdec-4e4f-acca-31613a9840ca req-3089e8c0-d141-4a06-afae-f5358ea08a5b service nova] Enqueued Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_members [ 1190.256606] env[65899]: INFO networking_nsxv3.common.synchronization [req-e8e422e3-cdec-4e4f-acca-31613a9840ca req-3089e8c0-d141-4a06-afae-f5358ea08a5b service nova] Enqueued Resource ID: 9a9136d7-a6e1-4431-89dd-8a0d8d5e9210 with Priority: HIGHEST for action port [ 1190.261705] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_rules [ 1190.261705] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_members [ 1190.261705] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9136d7-a6e1-4431-89dd-8a0d8d5e9210 with Priority: HIGHEST for action port [ 1190.261884] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e17851c9-16c9-44ea-b660-c316b983e92e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.261955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.262038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.262245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.262322] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.263841] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17851c9-16c9-44ea-b660-c316b983e92e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.263841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.263920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.264296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.264296] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.264450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.264450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.267856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.267856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.267856] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.267856] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.267856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.267856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.267856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.267856] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a9136d7-a6e1-4431-89dd-8a0d8d5e9210',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.388412] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 in Status: SUCCESS [ 1190.388412] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 deletion is rescheduled due to dependency. [ 1190.388412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.620716] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1190.620908] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b deletion is rescheduled due to dependency. [ 1190.621634] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.628628] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1190.628773] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.628934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.631467] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.631467] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.631467] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.631467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.631982] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.716011] env[65899]: INFO networking_nsxv3.common.synchronization [req-7d259eb0-a017-414e-976d-2f54115ec2d2 req-54c0ba21-f8af-4c8f-9275-b4d0e00ca408 tempest-ServerActionsTestOtherB-1521776614 tempest-ServerActionsTestOtherB-1521776614-project-member] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1190.716552] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1190.717193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.717288] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.717370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.717606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.717783] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.717923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.718017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.718229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.718819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.718911] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.767799] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17851c9-16c9-44ea-b660-c316b983e92e taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.767928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.768228] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.773246] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a9136d7-a6e1-4431-89dd-8a0d8d5e9210 with status ACTIVE [ 1190.773791] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.773791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.773791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.773791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.774268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.774508] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.774658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.774755] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.775093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.775093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.775311] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.775641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.775641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.775805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.776182] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.776182] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a9136d7-a6e1-4431-89dd-8a0d8d5e9210 is going to be updated. [ 1190.798652] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.799058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.799509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.800854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.801813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.801813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a9136d7-a6e1-4431-89dd-8a0d8d5e9210" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.101194] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.101431] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.101510] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.101771] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.102034] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.102192] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.102308] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.102518] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.102658] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.103048] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.103878] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.104108] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.104189] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.104665] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.104665] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.104665] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.125466] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.125603] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.125744] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.125928] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.126278] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-138ef883-b689-47ce-8917-d011de166929 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.126467] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-138ef883-b689-47ce-8917-d011de166929" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.126583] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-138ef883-b689-47ce-8917-d011de166929" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.126918] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-138ef883-b689-47ce-8917-d011de166929" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.127107] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('138ef883-b689-47ce-8917-d011de166929',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.134762] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10e0d2a4-e42f-49c4-b693-268f72e54b08: rpc.has_security_group_logging(os_id): False [ 1191.156243] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.156407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.156453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.157194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.180752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.181070] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.181214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.181272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.181444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.181528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.181735] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.181830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.181895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.182209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.182209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.182353] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.182399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.182428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.185173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.185173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.185173] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1191.221731] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.222040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.222040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.222683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.250673] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.250673] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.250673] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.250673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.270089] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1191.271532] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.276306] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.276462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.276511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.276706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.276838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.286384] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1191.630202] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.630436] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.630564] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.630896] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.631504] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.631504] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 138ef883-b689-47ce-8917-d011de166929 not found, creating... [ 1191.631618] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.631809] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.631896] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.632177] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.632374] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.632698] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.632951] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.633080] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.633345] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.633485] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.633622] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 138ef883-b689-47ce-8917-d011de166929 is going to be created. [ 1191.653957] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.654189] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.654316] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.654599] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.654905] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.655098] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-138ef883-b689-47ce-8917-d011de166929" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.776751] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.777023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.777128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.777358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.777441] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.777597] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17851c9-16c9-44ea-b660-c316b983e92e is going to be created. [ 1191.829337] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.829576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.829875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.830030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.830236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.844510] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17851c9-16c9-44ea-b660-c316b983e92e in Status: UNINITIALIZED for 2s [ 1192.045278] env[65899]: INFO networking_nsxv3.common.synchronization [req-1c779fed-b4b8-4f12-a8a9-a5c86858519f req-54b59ea9-dd25-41ea-99a9-c5dcea73f7a2 tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1192.045940] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1192.046232] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.046516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.046758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.047260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.047567] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.047677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.047741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.047904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.047990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.048105] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.409774] env[65899]: INFO networking_nsxv3.common.synchronization [req-7d259eb0-a017-414e-976d-2f54115ec2d2 req-26e500d9-88a7-4778-917c-ed0116757d58 service nova] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 1192.409774] env[65899]: INFO networking_nsxv3.common.synchronization [req-7d259eb0-a017-414e-976d-2f54115ec2d2 req-26e500d9-88a7-4778-917c-ed0116757d58 service nova] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1192.409774] env[65899]: INFO networking_nsxv3.common.synchronization [req-7d259eb0-a017-414e-976d-2f54115ec2d2 req-26e500d9-88a7-4778-917c-ed0116757d58 service nova] Enqueued Resource ID: 138ef883-b689-47ce-8917-d011de166929 with Priority: HIGHEST for action port [ 1192.410148] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 1192.410795] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1192.410941] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 138ef883-b689-47ce-8917-d011de166929 with Priority: HIGHEST for action port [ 1192.411310] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.411642] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.411765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.412015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.412241] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.414536] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.414658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.414869] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-138ef883-b689-47ce-8917-d011de166929 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.414971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-138ef883-b689-47ce-8917-d011de166929" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.415069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-138ef883-b689-47ce-8917-d011de166929" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.416713] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-138ef883-b689-47ce-8917-d011de166929" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.416713] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('138ef883-b689-47ce-8917-d011de166929',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.551568] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.551719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.551792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.552437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.578163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.578474] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.578602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.578673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.578878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.578981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.579080] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1192.613169] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.613169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.613169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.613169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.613169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.620205] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1192.915292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.915456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.916781] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 138ef883-b689-47ce-8917-d011de166929 with status ACTIVE [ 1192.917216] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.917216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.917216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.918031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.918031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.918031] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.918031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.918031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.918031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.918031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.918284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.919116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.919116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.919116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.919116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.919116] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 138ef883-b689-47ce-8917-d011de166929 is going to be updated. [ 1192.941509] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.941737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.942367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.942730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.942822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.942913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-138ef883-b689-47ce-8917-d011de166929" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.287865] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1193.288106] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.299071] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1193.299285] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 deletion is rescheduled due to dependency. [ 1193.299338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.299648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.299890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.300102] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.300319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.300319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.300458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.300543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.300933] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.802405] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.856493] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17851c9-16c9-44ea-b660-c316b983e92e in Status: SUCCESS [ 1193.856754] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.856950] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.857265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.857497] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.857624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.857690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.857846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.857929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.858107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.858253] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.307636] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.360930] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.631454] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1194.631744] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1194.631902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.810190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.810568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.810568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.810568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.810738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.810738] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1194.840094] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.840236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.840291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.840685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.840825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.850843] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1194.863922] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e17851c9-16c9-44ea-b660-c316b983e92e: rpc.has_security_group_logging(os_id): False [ 1194.895827] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.895977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.896057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.896309] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.896400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.896655] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.896757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.896819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.896966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.897049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.897216] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e17851c9-16c9-44ea-b660-c316b983e92e is going to be created. [ 1194.968896] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.969088] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.969172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.969468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.969616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.982228] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17851c9-16c9-44ea-b660-c316b983e92e in Status: IN_PROGRESS for 2s [ 1196.862984] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1196.862984] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.863639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.863639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.863834] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.864085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.864085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.864365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.864472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.864584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.864687] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.926299] env[65899]: INFO networking_nsxv3.common.synchronization [req-e7aa09fd-2c12-4b6d-b99d-9ae82c8770c4 req-f7407940-a7b5-4074-af91-c327041f6fb0 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1196.926299] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1196.927193] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.927509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.927810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.928135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.928452] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.928709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.929218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.929503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.929687] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.929903] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.999837] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e17851c9-16c9-44ea-b660-c316b983e92e in Status: SUCCESS [ 1196.999837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.367107] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.433586] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.433856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.434042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.434205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.434294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.434558] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.434665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.434725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.434945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.435068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.435245] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1197.440259] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.440511] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.440936] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.440936] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.441453] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.441628] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.441788] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.442028] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.442176] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.442629] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1197.442629] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1197.442736] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1197.442776] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1197.442859] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1197.443035] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1197.443177] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1197.480103] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1197.480583] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1197.480818] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1197.481149] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-418" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.481589] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.481796] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.481930] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.482310] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.482458] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.487906] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.488102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.488169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.488392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.488541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.500615] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1197.869618] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d97c0b7d-58d1-4baf-97be-f3a035518398: rpc.has_security_group_logging(os_id): False [ 1197.888515] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.888743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.888829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.889116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.889222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.889641] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.889783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.889867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.890063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.890147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.890252] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1197.960220] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.960429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.960429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.960780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.960839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.975529] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1197.985632] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.985957] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.986100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.986423] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.986675] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.990218] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3 not found, creating... [ 1197.990618] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.990823] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.990963] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.991284] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.991435] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.991791] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.991972] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.992102] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.992358] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.992517] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.992662] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3 is going to be created. [ 1198.031133] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.031365] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.031488] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.031805] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.032061] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.032303] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.791447] env[65899]: INFO networking_nsxv3.common.synchronization [req-e7aa09fd-2c12-4b6d-b99d-9ae82c8770c4 req-d6790059-a857-49af-8d9c-31afb14bf94f service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 1198.791576] env[65899]: INFO networking_nsxv3.common.synchronization [req-e7aa09fd-2c12-4b6d-b99d-9ae82c8770c4 req-d6790059-a857-49af-8d9c-31afb14bf94f service nova] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1198.791969] env[65899]: INFO networking_nsxv3.common.synchronization [req-e7aa09fd-2c12-4b6d-b99d-9ae82c8770c4 req-d6790059-a857-49af-8d9c-31afb14bf94f service nova] Enqueued Resource ID: 0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3 with Priority: HIGHEST for action port [ 1198.792437] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_rules [ 1198.792634] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1198.792774] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3 with Priority: HIGHEST for action port [ 1198.793196] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.793290] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.793350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.793737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.793863] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.795570] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.796608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.796608] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.796608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.796608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.796608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.796608] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.050759] env[65899]: INFO networking_nsxv3.common.synchronization [None req-7cba6353-2944-478f-9504-1a3924bd88cc None None] Enqueued Resource ID: a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2 with Priority: HIGHEST for action port [ 1199.053478] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2 with Priority: HIGHEST for action port [ 1199.055704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.055704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.055704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.055704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.055957] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.299401] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.299697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.300729] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3 with status ACTIVE [ 1199.300729] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.300729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.300729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.300948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.302013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.302013] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.302013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.302013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.302013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.302300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.302334] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.302872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.302872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.302872] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.303041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.304847] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3 is going to be updated. [ 1199.331909] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.332117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.332228] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.332524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.332704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.332922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bb71fc0-b5c3-4206-bdb4-38c5df17c3b3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.517037] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1199.517037] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b deletion is rescheduled due to dependency. [ 1199.517037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.517037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.517419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.517482] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.519226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.519226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.519226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.519226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.519226] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.558972] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2 [ 1199.559310] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.559805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.559805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.559805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.561904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.562041] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2 already deleted. [ 1199.562142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a62b4bf1-9495-42ef-a5fd-fa0f29c3c3c2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.990619] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1199.991039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.022160] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.372815] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.373160] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.373160] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.373402] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.373739] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.373931] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.374071] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.374300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.374461] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.374669] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.374775] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.374882] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.374990] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.375120] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1200.375252] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.375389] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.397442] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.397606] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1200.397739] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.397913] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-517" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.398282] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-1f802cc3-6336-4eb2-a623-2a229d168000 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.398462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.398581] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.398842] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.398982] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f802cc3-6336-4eb2-a623-2a229d168000',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.529026] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.565524] env[65899]: INFO networking_nsxv3.common.synchronization [None req-2c20024d-cf49-4f09-8f81-69f0c64ce7e3 None None] Enqueued Resource ID: 17ce7cb4-210f-4bb4-90c4-be3610e0150a with Priority: HIGHEST for action port [ 1200.566924] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17ce7cb4-210f-4bb4-90c4-be3610e0150a with Priority: HIGHEST for action port [ 1200.566924] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-17ce7cb4-210f-4bb4-90c4-be3610e0150a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.566924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17ce7cb4-210f-4bb4-90c4-be3610e0150a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.566924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17ce7cb4-210f-4bb4-90c4-be3610e0150a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.566924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17ce7cb4-210f-4bb4-90c4-be3610e0150a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.566924] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17ce7cb4-210f-4bb4-90c4-be3610e0150a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.902092] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.902313] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.902410] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.902701] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.902852] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.907031] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.907031] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.907031] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.907031] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.907031] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.907031] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.907031] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.907031] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.907031] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.907031] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.907655] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 1f802cc3-6336-4eb2-a623-2a229d168000 is going to be updated. [ 1200.931461] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.931461] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.931461] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.931673] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.931779] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.931996] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.029836] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.030040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.030119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.030367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.030473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.030575] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1201.069299] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17ce7cb4-210f-4bb4-90c4-be3610e0150a [ 1201.069580] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.069723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.069798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.070067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.070173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.070275] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17ce7cb4-210f-4bb4-90c4-be3610e0150a already deleted. [ 1201.070357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17ce7cb4-210f-4bb4-90c4-be3610e0150a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.081427] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.082890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.082982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.083200] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.083348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.093813] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1201.096023] env[65899]: INFO networking_nsxv3.common.synchronization [None req-28dd3c14-2d7b-4ee2-91bf-17f12a3dc481 None None] Enqueued Resource ID: 292afa9c-de32-47b9-a9e1-365069e9ec24 with Priority: HIGHEST for action port [ 1201.096023] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 292afa9c-de32-47b9-a9e1-365069e9ec24 with Priority: HIGHEST for action port [ 1201.096148] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-292afa9c-de32-47b9-a9e1-365069e9ec24 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.096283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-292afa9c-de32-47b9-a9e1-365069e9ec24" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.096327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-292afa9c-de32-47b9-a9e1-365069e9ec24" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.096577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-292afa9c-de32-47b9-a9e1-365069e9ec24" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.096942] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('292afa9c-de32-47b9-a9e1-365069e9ec24',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.598998] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 292afa9c-de32-47b9-a9e1-365069e9ec24 [ 1201.600507] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.600641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.600812] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.600960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.601083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.601187] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:292afa9c-de32-47b9-a9e1-365069e9ec24 already deleted. [ 1201.601282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-292afa9c-de32-47b9-a9e1-365069e9ec24" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.669405] env[65899]: INFO networking_nsxv3.common.synchronization [req-5732256d-711b-4316-9626-48e6ccaa710f req-2cdd62c3-a540-4565-834e-d70acf756364 service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 1201.669405] env[65899]: INFO networking_nsxv3.common.synchronization [req-5732256d-711b-4316-9626-48e6ccaa710f req-2cdd62c3-a540-4565-834e-d70acf756364 service nova] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1201.669405] env[65899]: INFO networking_nsxv3.common.synchronization [req-5732256d-711b-4316-9626-48e6ccaa710f req-2cdd62c3-a540-4565-834e-d70acf756364 service nova] Enqueued Resource ID: 1f802cc3-6336-4eb2-a623-2a229d168000 with Priority: HIGHEST for action port [ 1201.673020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_rules [ 1201.673020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1201.673020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f802cc3-6336-4eb2-a623-2a229d168000 with Priority: HIGHEST for action port [ 1201.673020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.673020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.673020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.673020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.673020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.673020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.673020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.673020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.673020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.673946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.673946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.673946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.673946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.673946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.673946] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.674640] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f802cc3-6336-4eb2-a623-2a229d168000 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.674778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.674847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.675037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.675154] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f802cc3-6336-4eb2-a623-2a229d168000',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.178133] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.178898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f802cc3-6336-4eb2-a623-2a229d168000 with status ACTIVE [ 1202.180101] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.180101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.180101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.180101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.180101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.180101] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.180723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.180723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.180723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.180723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.180723] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.180908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.180908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.181154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.181273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.181379] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f802cc3-6336-4eb2-a623-2a229d168000 is going to be updated. [ 1202.183131] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.183131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.222794] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.223019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.223065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.223274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.223431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.223614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f802cc3-6336-4eb2-a623-2a229d168000" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.684764] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.104378] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1203.105365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.105365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.105365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.105365] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.105695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.105695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.105760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.105871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.105940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.105987] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.192377] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.192377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.192377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.192377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.192377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.192377] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 1203.197064] env[65899]: INFO networking_nsxv3.common.synchronization [None req-3e034e2f-383d-484b-8003-5ec38ec0ebb8 None None] Enqueued Resource ID: 7f0a3ad2-e822-4d9b-963f-177c01ce5cf0 with Priority: HIGHEST for action port [ 1203.197463] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f0a3ad2-e822-4d9b-963f-177c01ce5cf0 with Priority: HIGHEST for action port [ 1203.198069] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f0a3ad2-e822-4d9b-963f-177c01ce5cf0 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.198069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f0a3ad2-e822-4d9b-963f-177c01ce5cf0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.198069] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f0a3ad2-e822-4d9b-963f-177c01ce5cf0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.199035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f0a3ad2-e822-4d9b-963f-177c01ce5cf0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.199035] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f0a3ad2-e822-4d9b-963f-177c01ce5cf0',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.233576] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.233576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.233576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.234011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.234011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.244897] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1203.566518] env[65899]: INFO networking_nsxv3.common.synchronization [None req-5a8bb011-414c-4d4e-9d1e-7a200011e524 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_rules [ 1203.567015] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_rules [ 1203.568498] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.568498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.568498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.568498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.568498] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.608542] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.608709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.608783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.608998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.609224] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.609295] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.609353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.609545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.609631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.609925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.609925] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.610055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.610055] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.610168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.610305] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.610395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.610452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.610586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.610658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.610735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.610822] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.704464] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f0a3ad2-e822-4d9b-963f-177c01ce5cf0 [ 1203.704464] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.704464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.704464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.704464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.704464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.704464] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f0a3ad2-e822-4d9b-963f-177c01ce5cf0 already deleted. [ 1203.704464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f0a3ad2-e822-4d9b-963f-177c01ce5cf0" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.824293] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9092adf9-ac94-44b3-9d1c-ce3ad157dd37 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_rules [ 1203.824743] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_rules [ 1203.825046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.825141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.099207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.099207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.099207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.099427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.099460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.099912] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 already deleted. [ 1204.100063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.100489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.100690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.100785] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.114727] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b: rpc.has_security_group_logging(os_id): False [ 1204.137669] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.137669] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.137669] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.137669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.138626] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.138948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.140762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.140762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.140762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.140762] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1204.202146] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.202289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.202465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.202554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.202796] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.216597] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1204.624505] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.624505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.624505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.624505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.624505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.624505] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 already deleted. [ 1204.624505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.254827] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1205.255223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.256315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.256590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.256793] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.256954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.257083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.257153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.257286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.257385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.257471] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.759521] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.759705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.759774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.759977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.760159] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.760254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.760301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.760466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.760529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.760614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.761410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.761525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.761600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.761725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.762945] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.763078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.763142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.763270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.763360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.763444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.763532] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.024051] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.024051] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.024379] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.024431] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.024810] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.024924] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.024973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.025521] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.025521] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.025638] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1206.025638] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1206.026136] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1206.026136] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1206.026136] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1206.026136] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1206.026321] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1206.047450] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1206.047636] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1206.047784] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1206.047973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-861" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.048337] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-c0bf33c7-894e-4ff2-a7eb-502afeb75261 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.048530] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.048643] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.048908] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.049062] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0bf33c7-894e-4ff2-a7eb-502afeb75261',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.234234] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1206.234593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.265483] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5b339ac-01aa-4f28-9e73-9f48477e571d: rpc.has_security_group_logging(os_id): False [ 1206.286145] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.286145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.286145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.286145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.306445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.306696] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.306989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.307077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.307341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.307429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.307637] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.307737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.307806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.308036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.308125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.308395] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.308503] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.308595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.308767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.308860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.308953] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 1206.370948] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.371161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.371205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.371433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.371783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.386250] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1206.552216] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.552594] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.552769] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.553110] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.553278] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.553585] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.553749] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.553861] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.554128] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.554267] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.554554] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.554847] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.554847] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.555063] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.555253] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.555440] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: c0bf33c7-894e-4ff2-a7eb-502afeb75261 is going to be updated. [ 1206.577803] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.578087] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.578379] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.578696] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.578905] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.579147] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.340754] env[65899]: INFO networking_nsxv3.common.synchronization [req-a7265687-c41c-4ee0-8320-4589d462b828 req-aeaf26cb-5f4f-4330-8919-1cd1d971b066 service nova] Enqueued Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_rules [ 1207.341021] env[65899]: INFO networking_nsxv3.common.synchronization [req-a7265687-c41c-4ee0-8320-4589d462b828 req-aeaf26cb-5f4f-4330-8919-1cd1d971b066 service nova] Enqueued Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_members [ 1207.341140] env[65899]: INFO networking_nsxv3.common.synchronization [req-a7265687-c41c-4ee0-8320-4589d462b828 req-aeaf26cb-5f4f-4330-8919-1cd1d971b066 service nova] Enqueued Resource ID: c0bf33c7-894e-4ff2-a7eb-502afeb75261 with Priority: HIGHEST for action port [ 1207.341838] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_rules [ 1207.342111] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_members [ 1207.342316] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0bf33c7-894e-4ff2-a7eb-502afeb75261 with Priority: HIGHEST for action port [ 1207.342737] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.342926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.343058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.343369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.343506] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.345387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.345516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.345662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.345913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.346111] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.346255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.346340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.346652] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.346798] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.347219] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.348014] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0bf33c7-894e-4ff2-a7eb-502afeb75261 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.348157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.348380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.348779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.349130] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0bf33c7-894e-4ff2-a7eb-502afeb75261',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.853607] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.853607] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.853607] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.853982] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0bf33c7-894e-4ff2-a7eb-502afeb75261 with status ACTIVE [ 1207.854047] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.854138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.854189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.854404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.854474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.854647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.854742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.854791] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.854955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.855465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.855704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.855848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.855883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.856030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.856129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.856217] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0bf33c7-894e-4ff2-a7eb-502afeb75261 is going to be updated. [ 1207.880952] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.881154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.881284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.881512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.881673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.881883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0bf33c7-894e-4ff2-a7eb-502afeb75261" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.358842] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.405061] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1208.405061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.861464] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.861674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.861751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.862042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.862164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.862269] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d is going to be updated. [ 1208.891585] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.891818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.891962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.892153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.892307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.902664] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: IN_PROGRESS for 2s [ 1209.356841] env[65899]: INFO networking_nsxv3.common.synchronization [req-04357406-2d90-442e-979e-d5d7e754f923 req-b91007bd-b198-4f2a-bfca-c574522ac104 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1209.357024] env[65899]: INFO networking_nsxv3.common.synchronization [req-04357406-2d90-442e-979e-d5d7e754f923 req-b91007bd-b198-4f2a-bfca-c574522ac104 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGHEST for action security_group_members [ 1209.357157] env[65899]: INFO networking_nsxv3.common.synchronization [req-04357406-2d90-442e-979e-d5d7e754f923 req-b91007bd-b198-4f2a-bfca-c574522ac104 tempest-SecurityGroupsTestJSON-211524460 tempest-SecurityGroupsTestJSON-211524460-project-member] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1209.357721] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 with Priority: HIGHEST for action security_group_members [ 1209.357853] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGHEST for action security_group_members [ 1209.357958] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGHEST for action security_group_members [ 1209.359452] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-10e0d2a4-e42f-49c4-b693-268f72e54b08 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.359452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.359844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.359844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.359844] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.360043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.360043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.360157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.360237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.360356] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10e0d2a4-e42f-49c4-b693-268f72e54b08',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.363665] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ac6b18-4924-425a-a674-ac5343806fa2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.363778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.363834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.363994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.364283] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.364338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.364389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.364542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.364623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.364713] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.365535] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.365601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.365635] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.365996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.365996] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.365996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.366109] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.366171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.366242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.366321] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.870626] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.870793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.870869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.871135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.871491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.871491] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.871873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.871873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.871873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.871873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.872013] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 is going to be updated. [ 1209.873215] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.873332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.873400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.873560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.874768] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.874899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.883338] env[65899]: INFO networking_nsxv3.common.synchronization [req-939c338e-655c-435c-8011-987e113d40f7 req-c63134e0-9414-4769-9e8a-3702249a78c5 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1209.883338] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1209.883338] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.883338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.883338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.883338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.883338] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.883338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.883338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.883338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.883338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.883338] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.900473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.900754] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.900896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.900955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.901160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.901244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.901336] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ac6b18-4924-425a-a674-ac5343806fa2 is going to be updated. [ 1209.902484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.902675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.905019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.905019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.905019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.905261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.905406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.918069] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: IN_PROGRESS for 2s [ 1209.931378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.931649] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.931783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.931904] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.932261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.932348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.932499] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be updated. [ 1209.936407] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.936543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.936612] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.936802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.936931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.949769] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: IN_PROGRESS for 2s [ 1209.966946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.967218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.967218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.967453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.967622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.978163] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: IN_PROGRESS for 2s [ 1210.243932] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.244171] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.244339] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.244644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.244876] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.245199] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.245365] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.245593] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.245737] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.245955] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.246072] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.246173] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.246275] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.246397] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.246686] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.246861] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.265638] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.265803] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1210.265941] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.266141] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.266452] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-a824f14a-f36e-4145-bc33-78b8020b6bc9 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.266636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-a824f14a-f36e-4145-bc33-78b8020b6bc9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.266762] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-a824f14a-f36e-4145-bc33-78b8020b6bc9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.267113] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-a824f14a-f36e-4145-bc33-78b8020b6bc9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.267265] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a824f14a-f36e-4145-bc33-78b8020b6bc9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.387641] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.387991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.387991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.387991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.388093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.388691] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.388691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.388691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.388691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.388691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.389028] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 already deleted. [ 1210.389028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.770019] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.770291] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.770391] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.770642] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.770787] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.770976] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port a824f14a-f36e-4145-bc33-78b8020b6bc9 not found, creating... [ 1210.771336] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.771601] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.771768] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.772024] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.772244] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.772642] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.772822] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.772974] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.773271] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.773419] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.773567] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: a824f14a-f36e-4145-bc33-78b8020b6bc9 is going to be created. [ 1210.797546] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.797782] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.797951] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.798300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.798569] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.798835] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-a824f14a-f36e-4145-bc33-78b8020b6bc9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.917066] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: SUCCESS [ 1210.917066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.917066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.917066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.917066] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.917066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.917066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.917066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.917066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.917066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.917066] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.418831] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.514119] env[65899]: INFO networking_nsxv3.common.synchronization [req-939c338e-655c-435c-8011-987e113d40f7 req-d5c65055-1d60-4fb4-9b7c-3d9b04d19a10 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1211.515190] env[65899]: INFO networking_nsxv3.common.synchronization [req-939c338e-655c-435c-8011-987e113d40f7 req-d5c65055-1d60-4fb4-9b7c-3d9b04d19a10 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1211.515190] env[65899]: INFO networking_nsxv3.common.synchronization [req-939c338e-655c-435c-8011-987e113d40f7 req-d5c65055-1d60-4fb4-9b7c-3d9b04d19a10 service nova] Enqueued Resource ID: a824f14a-f36e-4145-bc33-78b8020b6bc9 with Priority: HIGHEST for action port [ 1211.515190] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1211.515190] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1211.515190] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a824f14a-f36e-4145-bc33-78b8020b6bc9 with Priority: HIGHEST for action port [ 1211.515916] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.516134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.516234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.516541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.516660] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.518507] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.518721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.519857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.519857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.519857] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.519857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.519857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.519857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.519857] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.519857] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.522093] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a824f14a-f36e-4145-bc33-78b8020b6bc9 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.522215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a824f14a-f36e-4145-bc33-78b8020b6bc9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.523051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a824f14a-f36e-4145-bc33-78b8020b6bc9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.523051] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a824f14a-f36e-4145-bc33-78b8020b6bc9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.523136] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a824f14a-f36e-4145-bc33-78b8020b6bc9',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.921579] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08b51b44-1df0-4a96-9da8-8c013955ee0d: rpc.has_security_group_logging(os_id): False [ 1211.931087] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 in Status: SUCCESS [ 1211.931322] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10e0d2a4-e42f-49c4-b693-268f72e54b08 deletion is rescheduled due to dependency. [ 1211.931554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10e0d2a4-e42f-49c4-b693-268f72e54b08" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.944695] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.944897] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.944966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.945213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.963286] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ac6b18-4924-425a-a674-ac5343806fa2 in Status: SUCCESS [ 1211.963501] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ac6b18-4924-425a-a674-ac5343806fa2 deletion is rescheduled due to dependency. [ 1211.963648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.979530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.981043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.981272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.981354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.981626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.981747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.981874] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d is going to be updated. [ 1211.997613] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf in Status: SUCCESS [ 1211.997816] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf deletion is rescheduled due to dependency. [ 1211.998083] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.018866] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.019269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.022468] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.024615] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a824f14a-f36e-4145-bc33-78b8020b6bc9 with status ACTIVE [ 1212.024818] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.025581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.025581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.025581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.025581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.025581] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.025876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.025876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.025876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.025876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.026041] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.026211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.026211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.026323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.026520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.026520] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a824f14a-f36e-4145-bc33-78b8020b6bc9 is going to be updated. [ 1212.055383] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.055647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.055647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.055892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.056034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.064741] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.065104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.065104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.065359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.065409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.065532] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a824f14a-f36e-4145-bc33-78b8020b6bc9" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.071444] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: IN_PROGRESS for 2s [ 1212.143995] env[65899]: INFO networking_nsxv3.common.synchronization [req-6324804b-d094-4c2b-ae08-9d811d4aa1d5 req-6f7f183e-7903-401e-9743-ea1e4f1aa1bd tempest-ServersTestBootFromVolume-2100478652 tempest-ServersTestBootFromVolume-2100478652-project-member] Enqueued Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_members [ 1212.144797] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c86f328f-f619-4559-ae86-8793a284cfe3 with Priority: HIGHEST for action security_group_members [ 1212.145707] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-c86f328f-f619-4559-ae86-8793a284cfe3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.145707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.145707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.145707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.146091] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.146091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.146246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.146383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.146475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.146571] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c86f328f-f619-4559-ae86-8793a284cfe3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.525435] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.651131] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.651300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.651373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.651595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.677864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.677864] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.678702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.678702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.678702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.678702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.678702] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c86f328f-f619-4559-ae86-8793a284cfe3 is going to be updated. [ 1212.715827] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.715827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.715827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.715827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.715827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.726158] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c86f328f-f619-4559-ae86-8793a284cfe3 in Status: IN_PROGRESS for 2s [ 1213.027884] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.028142] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.028267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.028567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.028772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.028973] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be created. [ 1213.060907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.061093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.061168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.061425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.061599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.073854] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: UNINITIALIZED for 2s [ 1214.090596] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: SUCCESS [ 1214.091036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.742781] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c86f328f-f619-4559-ae86-8793a284cfe3 in Status: SUCCESS [ 1214.742781] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c86f328f-f619-4559-ae86-8793a284cfe3 deletion is rescheduled due to dependency. [ 1214.742781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c86f328f-f619-4559-ae86-8793a284cfe3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.087033] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1215.087234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.087427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.087659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.087863] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.087978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.088057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.088207] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.088285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.088435] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.088477] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.451719] env[65899]: INFO networking_nsxv3.common.synchronization [req-564b345c-65d4-44fb-95da-538245629100 req-651d7471-2f8f-4e9e-b701-7128bfb160a2 tempest-ServerDiskConfigTestJSON-776755957 tempest-ServerDiskConfigTestJSON-776755957-project-member] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1215.452360] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGHEST for action security_group_members [ 1215.452830] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.452954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.453072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.453396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.453574] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.453689] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.453753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.453942] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.454041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.454157] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.591423] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.591423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.591423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.591707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.591739] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.591838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.591901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.592060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.592146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.592230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.592378] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.592518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.592518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.592655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.592785] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.592937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.592937] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.593064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.593133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.593209] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.593295] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.957300] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.957522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.957596] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.957817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.957903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.958107] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.958198] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.958257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.958425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.958483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.958572] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be updated. [ 1215.990915] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.991086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.991086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.992729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.995046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.003327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: IN_PROGRESS for 2s [ 1216.094963] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15353240-f696-445d-9f9f-291a69a12406: rpc.has_security_group_logging(os_id): False [ 1216.116257] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.116410] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.116497] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.116698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.116806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.117039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.117149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.117204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.117418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.117554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.117726] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.117824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.117879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.118293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.118293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.118293] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.118417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.118417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.118545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.118616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.118699] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be created. [ 1216.180716] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.180877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.180925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.181152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.181333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.194932] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1216.920902] env[65899]: INFO networking_nsxv3.common.synchronization [req-fcb2531f-90ef-4432-80d2-c532ab4f3e7d req-9cceebbf-e02d-4caa-bd0e-9fba02d6e58c tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_members [ 1216.921362] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_members [ 1216.922665] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.922665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.922665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.922665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.922665] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.922665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.922665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.922665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.922665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.923033] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.338660] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-443 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.339095] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.339095] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.339414] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.339777] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.339931] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.340089] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.340328] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.340492] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.340763] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.340898] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.341015] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.341122] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.341230] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.341333] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.341469] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.378119] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.378424] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1217.378739] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.379070] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.379535] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-f1a86a85-db5e-474c-8f25-fe52355fa230 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.379912] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-f1a86a85-db5e-474c-8f25-fe52355fa230" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.380193] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-f1a86a85-db5e-474c-8f25-fe52355fa230" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.380815] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-f1a86a85-db5e-474c-8f25-fe52355fa230" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.381026] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1a86a85-db5e-474c-8f25-fe52355fa230',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.425018] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.425236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.425297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.425541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.425651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.425910] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.426033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.426121] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.426255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.426325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.426407] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 already deleted. [ 1217.426494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.884539] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.884989] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.884989] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.885403] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.885577] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.885735] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port f1a86a85-db5e-474c-8f25-fe52355fa230 not found, creating... [ 1217.886164] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.887924] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.887924] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.887924] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.887924] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.887924] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.887924] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.888518] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.888518] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.888518] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.888708] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: f1a86a85-db5e-474c-8f25-fe52355fa230 is going to be created. [ 1217.912672] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.912889] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.913034] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.913405] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.913666] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.913901] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-f1a86a85-db5e-474c-8f25-fe52355fa230" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.041180] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b in Status: SUCCESS [ 1218.041662] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b deletion is rescheduled due to dependency. [ 1218.041662] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.209055] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1218.209221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.624843] env[65899]: INFO networking_nsxv3.common.synchronization [req-fcb2531f-90ef-4432-80d2-c532ab4f3e7d req-57b56596-ef99-4afb-82b9-719150cec65c service nova] Enqueued Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_rules [ 1218.625386] env[65899]: INFO networking_nsxv3.common.synchronization [req-fcb2531f-90ef-4432-80d2-c532ab4f3e7d req-57b56596-ef99-4afb-82b9-719150cec65c service nova] Enqueued Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_members [ 1218.625386] env[65899]: INFO networking_nsxv3.common.synchronization [req-fcb2531f-90ef-4432-80d2-c532ab4f3e7d req-57b56596-ef99-4afb-82b9-719150cec65c service nova] Enqueued Resource ID: f1a86a85-db5e-474c-8f25-fe52355fa230 with Priority: HIGHEST for action port [ 1218.625829] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_rules [ 1218.625993] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_members [ 1218.626104] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a86a85-db5e-474c-8f25-fe52355fa230 with Priority: HIGHEST for action port [ 1218.626397] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.626512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.626578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.626779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.626853] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.627841] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.627955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.628035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.628234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.628405] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.628553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.628639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.628838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.628970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.629130] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.630364] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1a86a85-db5e-474c-8f25-fe52355fa230 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.630528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1a86a85-db5e-474c-8f25-fe52355fa230" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.630643] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1a86a85-db5e-474c-8f25-fe52355fa230" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.630878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1a86a85-db5e-474c-8f25-fe52355fa230" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.630999] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1a86a85-db5e-474c-8f25-fe52355fa230',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.133677] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.135639] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.135639] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.135639] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1a86a85-db5e-474c-8f25-fe52355fa230 with status ACTIVE [ 1219.135880] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.135880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.135880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.136167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.136230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.137184] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.137184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.137184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.137184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.137184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.137184] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.137184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.137184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.137577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.137577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.137577] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1a86a85-db5e-474c-8f25-fe52355fa230 is going to be updated. [ 1219.158975] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.159237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.159237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.159467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.159657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.159852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1a86a85-db5e-474c-8f25-fe52355fa230" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.290966] env[65899]: INFO networking_nsxv3.common.synchronization [req-3bfbef4e-b2ad-4aba-a71d-6290553186c6 req-a5a437b0-4a9c-4a81-8ff8-7a8964e931df tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1219.292016] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1219.292558] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.292558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.292719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.292763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.292913] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.293017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.293075] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.293224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.293307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.293397] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.641278] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.653639] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.653639] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.653639] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.653902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.655102] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.656027] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.656027] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.656027] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.656027] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.656027] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.656232] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.656232] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.656345] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.656458] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.656561] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.656691] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.676611] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.676849] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.677045] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.677381] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.677965] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-21830b1e-3863-45e3-81c2-e95f7007ecc2 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.678158] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-21830b1e-3863-45e3-81c2-e95f7007ecc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.678395] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-21830b1e-3863-45e3-81c2-e95f7007ecc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.678805] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-21830b1e-3863-45e3-81c2-e95f7007ecc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.678997] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21830b1e-3863-45e3-81c2-e95f7007ecc2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.798160] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.798160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.798160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.798456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.798456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.798541] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.798591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.798660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.798827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.798903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.798987] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1219.858883] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.859079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.859127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.859358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.859515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.879944] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1220.144222] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.144582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.144582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.144649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.144749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.144857] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 is going to be created. [ 1220.172369] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.172541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.172541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.172720] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.172866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.183752] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.183992] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.184134] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.184418] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.184568] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.184720] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 21830b1e-3863-45e3-81c2-e95f7007ecc2 not found, creating... [ 1220.184982] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.185150] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.185265] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.185518] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.185725] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.186030] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.186191] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.186305] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.186511] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.186642] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.186811] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 21830b1e-3863-45e3-81c2-e95f7007ecc2 is going to be created. [ 1220.188540] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 in Status: UNINITIALIZED for 2s [ 1220.209025] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.209239] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.209368] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.209648] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.209928] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.210208] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-21830b1e-3863-45e3-81c2-e95f7007ecc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.812959] env[65899]: INFO networking_nsxv3.common.synchronization [req-297be9a5-3604-44a4-8578-23ef063d3a19 req-79a9818d-71d5-4097-998d-cc19130ff94d tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1220.813573] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1220.813905] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.814046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.814108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.814310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.814471] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.814571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.814629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.814839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.814938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.815043] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.935340] env[65899]: INFO networking_nsxv3.common.synchronization [req-3bfbef4e-b2ad-4aba-a71d-6290553186c6 req-5bfff3b9-b9c4-4902-a34a-b556cc0071f2 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1220.935510] env[65899]: INFO networking_nsxv3.common.synchronization [req-3bfbef4e-b2ad-4aba-a71d-6290553186c6 req-5bfff3b9-b9c4-4902-a34a-b556cc0071f2 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1220.935649] env[65899]: INFO networking_nsxv3.common.synchronization [req-3bfbef4e-b2ad-4aba-a71d-6290553186c6 req-5bfff3b9-b9c4-4902-a34a-b556cc0071f2 service nova] Enqueued Resource ID: 21830b1e-3863-45e3-81c2-e95f7007ecc2 with Priority: HIGHEST for action port [ 1220.936174] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1220.936357] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1220.936426] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21830b1e-3863-45e3-81c2-e95f7007ecc2 with Priority: HIGHEST for action port [ 1220.936656] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.936777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.936840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.937045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.937126] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.938404] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.938404] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.938617] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-21830b1e-3863-45e3-81c2-e95f7007ecc2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.938702] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21830b1e-3863-45e3-81c2-e95f7007ecc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.938750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21830b1e-3863-45e3-81c2-e95f7007ecc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.939035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21830b1e-3863-45e3-81c2-e95f7007ecc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.939035] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21830b1e-3863-45e3-81c2-e95f7007ecc2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.318367] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.440596] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.440768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.442175] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21830b1e-3863-45e3-81c2-e95f7007ecc2 with status ACTIVE [ 1221.442360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.442478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.442548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.442764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.442853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.443036] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.443136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.443201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.443352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.443429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.443609] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.443701] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.443781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.443893] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.444395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.444395] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21830b1e-3863-45e3-81c2-e95f7007ecc2 is going to be updated. [ 1221.468625] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.468766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.468855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.469037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.469171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.469327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21830b1e-3863-45e3-81c2-e95f7007ecc2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.820184] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.891052] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1221.891052] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1221.891052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.891052] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.891294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.891429] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.891548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.891611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.891756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.891839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.891925] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.199330] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 in Status: SUCCESS [ 1222.199603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.199802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.200016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.200213] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.200341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.200408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.200610] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.200699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.200795] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.200907] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.323303] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.323793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.323793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.323793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.323966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.323966] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a73361-0065-4c2b-847b-544a63c06efc is going to be updated. [ 1222.351913] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.352119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.352119] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.352329] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.352474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.363498] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: IN_PROGRESS for 2s [ 1222.393967] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.704023] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.896821] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.206526] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa9bf74b-89b9-48d3-b394-0eb584bf5c54: rpc.has_security_group_logging(os_id): False [ 1223.227161] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.227322] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.227360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.227637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.227729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.227992] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.228111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.228172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.228483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.228483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.228483] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 is going to be created. [ 1223.298360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.298690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.298750] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.298966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.299227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.313044] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 in Status: IN_PROGRESS for 2s [ 1223.399859] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.400157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.400157] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.400331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.400419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.400518] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1223.458037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.458188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.458258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.458486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.458650] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.469061] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1224.064235] env[65899]: INFO networking_nsxv3.common.synchronization [req-c5e956e2-dd8d-49af-bec3-e60ff443b39f req-1e564f81-73f6-4b11-9eb5-9d2571e307f8 tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 1224.064352] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 1224.064695] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.064913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.064913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.065361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.065562] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.065726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.065832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.066033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.066323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.066323] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.373828] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: SUCCESS [ 1224.374120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.396149] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.396362] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.396488] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.396753] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.397060] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.397224] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.397349] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.397637] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.397792] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.398041] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.398159] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.398273] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.398379] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.398502] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.398616] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.398794] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.417872] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.418298] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1224.418298] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.418504] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-507" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.418883] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-b4c861ea-9216-40db-b5b9-e31dab067a00 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.419137] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-b4c861ea-9216-40db-b5b9-e31dab067a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.419282] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-b4c861ea-9216-40db-b5b9-e31dab067a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.419647] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-b4c861ea-9216-40db-b5b9-e31dab067a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.419893] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c861ea-9216-40db-b5b9-e31dab067a00',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.569343] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.922054] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.922350] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.922422] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.922700] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.922851] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.923015] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port b4c861ea-9216-40db-b5b9-e31dab067a00 not found, creating... [ 1224.923305] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.923464] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.923582] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.923801] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.923926] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.924219] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.924374] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.924490] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.924694] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.924825] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.924952] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: b4c861ea-9216-40db-b5b9-e31dab067a00 is going to be created. [ 1224.944746] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.944955] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.945092] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.945365] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.945636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.945863] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-b4c861ea-9216-40db-b5b9-e31dab067a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.071438] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.325047] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 in Status: SUCCESS [ 1225.325258] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.479831] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1225.480105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.480261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.480474] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.480665] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.480778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.480841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.480991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.481079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.481161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.481479] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.577704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.577704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.577704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.577704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.577704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.577704] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be updated. [ 1225.606167] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.606338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.606338] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.606530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.606650] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.620550] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: IN_PROGRESS for 2s [ 1225.686283] env[65899]: INFO networking_nsxv3.common.synchronization [req-c5e956e2-dd8d-49af-bec3-e60ff443b39f req-256bb404-da2a-4cff-99d0-7e89b4b22158 service nova] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_rules [ 1225.686538] env[65899]: INFO networking_nsxv3.common.synchronization [req-c5e956e2-dd8d-49af-bec3-e60ff443b39f req-256bb404-da2a-4cff-99d0-7e89b4b22158 service nova] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 1225.686742] env[65899]: INFO networking_nsxv3.common.synchronization [req-c5e956e2-dd8d-49af-bec3-e60ff443b39f req-256bb404-da2a-4cff-99d0-7e89b4b22158 service nova] Enqueued Resource ID: b4c861ea-9216-40db-b5b9-e31dab067a00 with Priority: HIGHEST for action port [ 1225.687602] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_rules [ 1225.687787] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 1225.687917] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4c861ea-9216-40db-b5b9-e31dab067a00 with Priority: HIGHEST for action port [ 1225.688366] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.688576] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.688695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.688992] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.689144] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.690345] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.690477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.690763] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4c861ea-9216-40db-b5b9-e31dab067a00 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.690895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4c861ea-9216-40db-b5b9-e31dab067a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.690988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4c861ea-9216-40db-b5b9-e31dab067a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.691259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4c861ea-9216-40db-b5b9-e31dab067a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.691359] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c861ea-9216-40db-b5b9-e31dab067a00',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.986268] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.986268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.986268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.986268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.986268] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.986584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.986584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.986584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.986684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.986718] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.986850] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.986939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.986989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.987843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.987843] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.987843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.987843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.987843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.987843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.987843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.987843] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.193140] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.193355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.193462] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4c861ea-9216-40db-b5b9-e31dab067a00 with status ACTIVE [ 1226.193629] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.193733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.193813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.193998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.194085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.194259] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.194381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.194417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.194562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.194684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.194822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.194934] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.194979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.195121] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.195199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.195281] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4c861ea-9216-40db-b5b9-e31dab067a00 is going to be updated. [ 1226.217958] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.218174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.218174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.218391] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.218540] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.218722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4c861ea-9216-40db-b5b9-e31dab067a00" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.490215] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3990baf0-9e24-4b70-8c31-60cf273fe344: rpc.has_security_group_logging(os_id): False [ 1226.513099] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.513257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.513330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.513545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.513637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.513927] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.514049] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.514114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.514281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.514361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.514557] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.514646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.514703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.514846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.514913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.515128] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.515208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.515266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.515422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.515538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.515683] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1226.599289] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.599550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.599550] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.600188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.600472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.618278] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1227.631159] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: SUCCESS [ 1227.631499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.631574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.631837] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.632063] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.632176] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.632241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.632389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.632534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.632597] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.135144] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.632455] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1228.632767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.638623] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.142898] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.143226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.143226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.143417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.143514] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.143702] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be updated. [ 1229.173691] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.173877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.173877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.174256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.174415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.184180] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: IN_PROGRESS for 2s [ 1230.689397] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.689674] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1231.015910] env[65899]: INFO networking_nsxv3.common.synchronization [None req-f1d7b50d-89fe-4da7-b248-42728d6906f8 None None] Enqueued Resource ID: f43ab83d-2044-477f-a3bf-e1a989598a52 with Priority: HIGHEST for action port [ 1231.016565] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43ab83d-2044-477f-a3bf-e1a989598a52 with Priority: HIGHEST for action port [ 1231.019496] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f43ab83d-2044-477f-a3bf-e1a989598a52 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.019730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f43ab83d-2044-477f-a3bf-e1a989598a52" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.019805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f43ab83d-2044-477f-a3bf-e1a989598a52" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.020103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f43ab83d-2044-477f-a3bf-e1a989598a52" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.020206] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f43ab83d-2044-477f-a3bf-e1a989598a52',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.201875] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: SUCCESS [ 1231.201875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.201875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.201875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.201875] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.201875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.201875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.201875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.201875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.201875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.201875] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.523149] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f43ab83d-2044-477f-a3bf-e1a989598a52 [ 1231.523284] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.523365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.523365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.524021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.524021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.524021] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f43ab83d-2044-477f-a3bf-e1a989598a52 already deleted. [ 1231.524021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f43ab83d-2044-477f-a3bf-e1a989598a52" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.704999] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.944600] env[65899]: INFO networking_nsxv3.common.synchronization [None req-9fbbb16d-559e-471d-9eb3-c2c2fa711309 tempest-ServerActionsV293TestJSON-786500862 tempest-ServerActionsV293TestJSON-786500862-project-member] Enqueued Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_rules [ 1231.947039] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_rules [ 1231.947039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.947039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.947039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.947039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.947039] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.080219] env[65899]: INFO networking_nsxv3.common.synchronization [None req-0e2c0b8c-17c5-4969-836b-102d62b08961 tempest-ServerActionsV293TestJSON-786500862 tempest-ServerActionsV293TestJSON-786500862-project-member] Enqueued Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_rules [ 1232.080824] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_rules [ 1232.084239] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.084372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.214683] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 743c5a69-4fa0-4875-ab4b-14b45b31c03c: rpc.has_security_group_logging(os_id): False [ 1232.233197] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.233197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.233197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.233197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.262138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.262538] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.262538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.262678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.263423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.263423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.263423] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be updated. [ 1232.351706] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.353129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.353129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.353129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.353129] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.370439] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: IN_PROGRESS for 2s [ 1232.482707] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.482868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.482952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.483173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.483235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.483334] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd already deleted. [ 1232.483417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.483582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.483731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.483812] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.007507] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.007507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.007507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.007507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.007507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.007507] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd already deleted. [ 1233.007507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.428426] env[65899]: INFO networking_nsxv3.common.synchronization [None req-8c973564-76fc-4369-afb6-2b98f989a0ae None None] Enqueued Resource ID: af99c949-0a5d-4269-807f-3d0152b01439 with Priority: HIGHEST for action port [ 1233.428844] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af99c949-0a5d-4269-807f-3d0152b01439 with Priority: HIGHEST for action port [ 1233.429206] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-af99c949-0a5d-4269-807f-3d0152b01439 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.429344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af99c949-0a5d-4269-807f-3d0152b01439" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.429393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af99c949-0a5d-4269-807f-3d0152b01439" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.429632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af99c949-0a5d-4269-807f-3d0152b01439" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.429740] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af99c949-0a5d-4269-807f-3d0152b01439',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.936240] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af99c949-0a5d-4269-807f-3d0152b01439 [ 1233.936838] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.936838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.936838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.936838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.937082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.937082] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af99c949-0a5d-4269-807f-3d0152b01439 already deleted. [ 1233.937138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af99c949-0a5d-4269-807f-3d0152b01439" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.388050] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: SUCCESS [ 1234.388050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.098706] env[65899]: INFO networking_nsxv3.common.synchronization [req-c769eaf6-1648-4246-9bb4-2d227c5a2de5 req-7018da94-07b2-4862-af1e-b8a9f0e3183b tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1235.099370] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1235.099701] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.099829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.099898] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.100117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.100274] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.100373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.100429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.104027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.104027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.104027] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.604455] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.604745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.604745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.604927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.605027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.605234] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.605323] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.605400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.605565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.605608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.605672] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1235.637174] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.637328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.637439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.637599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.637741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.647608] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1236.604256] env[65899]: INFO networking_nsxv3.common.synchronization [req-0bd7fc41-4865-4d0b-9865-4d00121c660c req-24955ebd-81e4-40de-bca9-50feb4df4433 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1236.605254] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1236.605767] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.605974] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.606103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.606384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.606603] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.606765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.606878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.607121] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.607262] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.607412] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.705256] env[65899]: INFO networking_nsxv3.common.synchronization [req-64d9a32d-611a-4308-ac21-01e3128a8e77 req-900c87d5-1991-4866-b8ed-80920ddc95b0 tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1236.706427] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a73361-0065-4c2b-847b-544a63c06efc with Priority: HIGHEST for action security_group_members [ 1236.706870] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6a73361-0065-4c2b-847b-544a63c06efc taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.707059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.707167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.707451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.707708] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.707862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.707960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.708225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.708355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.708497] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6a73361-0065-4c2b-847b-544a63c06efc',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.972712] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.974015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.974015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.974015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.974015] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.974015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.974015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.974289] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.974323] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.974515] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.974620] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.974780] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.974874] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.974995] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.975101] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.975247] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.994500] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.994746] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1236.994892] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.995090] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.995479] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.995714] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.995851] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.996237] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.996410] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91c277c5-8d14-4ca9-a6a7-bbc6e9850660',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.109795] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.211085] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.211085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.211085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.211426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.233475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.233748] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.233882] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.233923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.234160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.234251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.234346] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a73361-0065-4c2b-847b-544a63c06efc is going to be updated. [ 1237.262157] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.262319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.262417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.262645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.262815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.273508] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: IN_PROGRESS for 2s [ 1237.499030] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.499340] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.499476] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.500014] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.500202] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.500364] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 91c277c5-8d14-4ca9-a6a7-bbc6e9850660 not found, creating... [ 1237.500680] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.500872] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.501012] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.501302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.501462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.501836] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.502087] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.502152] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.502377] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.502614] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.502691] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 91c277c5-8d14-4ca9-a6a7-bbc6e9850660 is going to be created. [ 1237.544672] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.544902] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.546238] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.546238] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.546238] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.546238] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.612041] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.667653] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1237.667828] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1237.667997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.114772] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.115134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.115216] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.116034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.116034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.116034] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1238.153864] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.154089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.154089] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.154287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.154429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.165229] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1238.283996] env[65899]: INFO networking_nsxv3.common.synchronization [req-0bd7fc41-4865-4d0b-9865-4d00121c660c req-9c19efb4-55c1-4270-acbf-c42e3f0b820c service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1238.284188] env[65899]: INFO networking_nsxv3.common.synchronization [req-0bd7fc41-4865-4d0b-9865-4d00121c660c req-9c19efb4-55c1-4270-acbf-c42e3f0b820c service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1238.284317] env[65899]: INFO networking_nsxv3.common.synchronization [req-0bd7fc41-4865-4d0b-9865-4d00121c660c req-9c19efb4-55c1-4270-acbf-c42e3f0b820c service nova] Enqueued Resource ID: 91c277c5-8d14-4ca9-a6a7-bbc6e9850660 with Priority: HIGHEST for action port [ 1238.284845] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1238.285103] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1238.285103] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91c277c5-8d14-4ca9-a6a7-bbc6e9850660 with Priority: HIGHEST for action port [ 1238.286928] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.288286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.288286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.288286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.288286] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.289470] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.289470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.291489] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.291489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.291489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.291489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.291489] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91c277c5-8d14-4ca9-a6a7-bbc6e9850660',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.792380] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.792624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.798772] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91c277c5-8d14-4ca9-a6a7-bbc6e9850660 with status ACTIVE [ 1238.798772] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.798772] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.798772] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.798772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.798772] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91c277c5-8d14-4ca9-a6a7-bbc6e9850660 is going to be updated. [ 1238.818887] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.819057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.819130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.819358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.819513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.819672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91c277c5-8d14-4ca9-a6a7-bbc6e9850660" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.288533] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6a73361-0065-4c2b-847b-544a63c06efc in Status: SUCCESS [ 1239.288533] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6a73361-0065-4c2b-847b-544a63c06efc deletion is rescheduled due to dependency. [ 1239.288533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6a73361-0065-4c2b-847b-544a63c06efc" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.572686] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.572686] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.572686] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.572686] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.572686] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.572686] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.572686] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.572686] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.572686] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.572686] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1239.573232] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.573232] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.573232] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.573232] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1239.573348] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.573386] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.593519] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.593671] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1239.594561] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.594561] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-245" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.594561] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-48c09a80-06ab-4b73-b5b1-2c861f6ee447 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.594561] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.594561] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.594822] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.594951] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48c09a80-06ab-4b73-b5b1-2c861f6ee447',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.097921] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.098288] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.098288] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.098675] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.098926] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.099312] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.099534] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.099681] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.100139] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.100215] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.100542] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.100720] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.100882] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.101144] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.101300] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.101508] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 48c09a80-06ab-4b73-b5b1-2c861f6ee447 is going to be updated. [ 1240.128301] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.128667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.128896] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.129364] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.129688] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.130071] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.176675] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1240.176928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.177123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.177416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.177646] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.177805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.177873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.178060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.178154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.178293] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.680199] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.839537] env[65899]: INFO networking_nsxv3.common.synchronization [req-69ac88eb-dfbd-4946-8418-5833934dc973 req-7c588646-141b-4d3f-9501-8333b612f813 service nova] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_rules [ 1240.839762] env[65899]: INFO networking_nsxv3.common.synchronization [req-69ac88eb-dfbd-4946-8418-5833934dc973 req-7c588646-141b-4d3f-9501-8333b612f813 service nova] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1240.840021] env[65899]: INFO networking_nsxv3.common.synchronization [req-69ac88eb-dfbd-4946-8418-5833934dc973 req-7c588646-141b-4d3f-9501-8333b612f813 service nova] Enqueued Resource ID: 48c09a80-06ab-4b73-b5b1-2c861f6ee447 with Priority: HIGHEST for action port [ 1240.840578] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_rules [ 1240.840748] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1240.840896] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48c09a80-06ab-4b73-b5b1-2c861f6ee447 with Priority: HIGHEST for action port [ 1240.841256] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.841446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.841609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.841732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.841862] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.842970] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.842970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.843143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.843260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.843433] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.843548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.843615] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.843816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.843931] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.844078] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.844977] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-48c09a80-06ab-4b73-b5b1-2c861f6ee447 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.845138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.845266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.845370] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.845457] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48c09a80-06ab-4b73-b5b1-2c861f6ee447',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.183042] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.348260] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.349196] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.349425] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.349614] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48c09a80-06ab-4b73-b5b1-2c861f6ee447 with status ACTIVE [ 1241.349780] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.349906] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.350012] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.350321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.350457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.351046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.351046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.351168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.351402] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.351534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.351810] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.352135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.352135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.352366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.352483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.352539] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48c09a80-06ab-4b73-b5b1-2c861f6ee447 is going to be updated. [ 1241.380176] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.380331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.380371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.380549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.380685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.380839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48c09a80-06ab-4b73-b5b1-2c861f6ee447" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.685547] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.685697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.685765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.685982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.686352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.686352] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1241.719223] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.719451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.719515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.719686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.719832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.730158] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1241.854782] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.358380] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.358947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.358947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.359093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.359093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.359227] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be updated. [ 1242.402787] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.403036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.403036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.403252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.403399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.413739] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1243.745201] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1243.746159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.747097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.747097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.747097] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.747097] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.747347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.747347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.747489] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.747548] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.747613] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.883677] env[65899]: INFO networking_nsxv3.common.synchronization [req-ad2ec3ee-0674-4365-be9c-a2118023c300 req-7bdc448f-7db9-44b2-8218-ae5ea5cb8680 tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_members [ 1243.884994] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGHEST for action security_group_members [ 1243.885233] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.886164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.886164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.886164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.886164] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.886164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.886164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.886164] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.886580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.886580] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.251560] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.251778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.251778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.252033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.252211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.252333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.252392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.252501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.252583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.252667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.252895] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.253062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.253226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.253226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.253345] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.253491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.253491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.253613] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.253777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.253777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.253997] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.388360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.388560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.388600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.388813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.416356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.416608] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.416700] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.416751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.416998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.417094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.417184] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 is going to be updated. [ 1244.426053] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1244.426257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.426408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.426614] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.426800] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.426925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.426998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.427140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.427234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.427308] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.427384] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.444542] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.444875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.444875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.445123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.445123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.455932] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 in Status: IN_PROGRESS for 2s [ 1244.759208] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15353240-f696-445d-9f9f-291a69a12406: rpc.has_security_group_logging(os_id): False [ 1244.779529] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.779658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.779732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.779955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.780140] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.780357] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.780465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.780523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.780664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.780729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.780955] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.781041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.781041] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.781301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.781301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.781429] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.781544] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.781600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.781688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.781819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.781879] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1244.864936] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.865105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.865174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.865381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.865525] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.894940] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1244.930054] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.930054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.930054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.930054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.930410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.930555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.930623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.930802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.930979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.931088] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.931265] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.931380] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.931621] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.931799] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.931950] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.932073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.932183] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.932356] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.932440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.932524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.932612] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.435290] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd672f3d-6117-44aa-8b2f-40dde93f9373: rpc.has_security_group_logging(os_id): False [ 1245.452822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.452994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.453072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.453256] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.473107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.473397] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.473523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.473588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.473786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.473869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.474252] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.474252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.474252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.474397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.474549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.474590] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.474853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.474853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.474853] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.475020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.475020] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be updated. [ 1245.537032] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.537201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.537248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.537461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.537603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.551243] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1246.467060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 in Status: SUCCESS [ 1246.467060] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 deletion is rescheduled due to dependency. [ 1246.467060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.913674] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1246.913918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.566889] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1247.567317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.886826] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1248.886826] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1249.935085] env[65899]: INFO networking_nsxv3.common.synchronization [None req-5afe3d94-9ad2-430c-97de-8ef3fc8debea tempest-AttachInterfacesTestJSON-220417290 tempest-AttachInterfacesTestJSON-220417290-project-member] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1249.936086] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGHEST for action security_group_members [ 1249.936496] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.936586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.937016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.937283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.937472] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.937588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.937651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.937908] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.938606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.938606] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.444712] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.444712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.444712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.444712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.444712] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.445038] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.445038] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.445141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.445231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.445324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.446055] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be updated. [ 1250.478281] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.478418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.478507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.478751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.478860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.491281] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: IN_PROGRESS for 2s [ 1252.333041] env[65899]: INFO networking_nsxv3.common.synchronization [req-7aad1f46-7c2f-40ce-b8ee-ea1c2ac8dd52 req-84fa8f92-e876-436c-be9e-af903ba28cfc tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1252.333574] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1252.333975] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.334118] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.334183] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.334378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.334532] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.334620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.334680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.334825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.334899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.335012] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.514267] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5b339ac-01aa-4f28-9e73-9f48477e571d in Status: SUCCESS [ 1252.514477] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d deletion is rescheduled due to dependency. [ 1252.514591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.837886] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.341149] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.844136] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.844294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.844353] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.844623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.844724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.844803] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1253.875369] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.875547] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.875588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.875800] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.875945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.888789] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1255.900275] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1255.900604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.334396] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.334756] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.332142] env[65899]: INFO networking_nsxv3.common.synchronization [req-5282348d-89bd-424d-9e39-a26574dc8829 req-32826dd2-4eb4-4ec8-bb70-b8d156bcb062 tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1258.332671] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1258.332973] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.333113] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.333179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.333375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.333524] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.333620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.333680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.333895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.333964] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.334013] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.676997] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-122 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.676997] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.676997] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.676997] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.677480] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.677480] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.677480] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.677655] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.677814] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.678119] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1258.678239] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1258.678346] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1258.678450] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1258.678559] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1258.678659] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1258.678787] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1258.702710] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1258.702878] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1258.703028] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1258.703205] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-122" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.703556] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-434de563-bc30-459b-bc37-800b1b58c842 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.703738] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-434de563-bc30-459b-bc37-800b1b58c842" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.703861] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-434de563-bc30-459b-bc37-800b1b58c842" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.704263] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-434de563-bc30-459b-bc37-800b1b58c842" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.704403] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('434de563-bc30-459b-bc37-800b1b58c842',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.838466] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.838466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.838466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.838466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.838466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.838466] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.838466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.838466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.838466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.838466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.838466] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1258.864534] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.864534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.864534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.864534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.864534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.873186] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1259.159087] env[65899]: INFO networking_nsxv3.common.synchronization [req-2433cf73-0871-4dca-96ae-da5580bb8d59 req-6f3720d8-6b47-44ba-b91d-c9717cf96bae tempest-AttachVolumeShelveTestJSON-1192841755 tempest-AttachVolumeShelveTestJSON-1192841755-project-member] Enqueued Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_members [ 1259.159701] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d with Priority: HIGHEST for action security_group_members [ 1259.160055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-08b51b44-1df0-4a96-9da8-8c013955ee0d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.160271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.160271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.161026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.161026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.161026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.161026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.161026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.161026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.161487] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08b51b44-1df0-4a96-9da8-8c013955ee0d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.207987] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.208274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.208380] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.208695] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.208848] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.209074] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 434de563-bc30-459b-bc37-800b1b58c842 not found, creating... [ 1259.209404] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.209577] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.209695] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.209927] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.210104] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.210418] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.210574] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.210710] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.210926] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.211110] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.211256] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 434de563-bc30-459b-bc37-800b1b58c842 is going to be created. [ 1259.235408] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.235695] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.235907] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.236214] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.236447] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.236704] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-434de563-bc30-459b-bc37-800b1b58c842" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.663337] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.663478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.663606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.663814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.663913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.664127] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.664232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.664299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.664450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.664538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.664646] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d is going to be updated. [ 1259.694039] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.694039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.694039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.694039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.694471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.704887] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: IN_PROGRESS for 2s [ 1259.984274] env[65899]: INFO networking_nsxv3.common.synchronization [req-5282348d-89bd-424d-9e39-a26574dc8829 req-d0d360f6-67fc-4309-838c-bd95dffbcc17 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1259.984552] env[65899]: INFO networking_nsxv3.common.synchronization [req-5282348d-89bd-424d-9e39-a26574dc8829 req-d0d360f6-67fc-4309-838c-bd95dffbcc17 service nova] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1259.984755] env[65899]: INFO networking_nsxv3.common.synchronization [req-5282348d-89bd-424d-9e39-a26574dc8829 req-d0d360f6-67fc-4309-838c-bd95dffbcc17 service nova] Enqueued Resource ID: 434de563-bc30-459b-bc37-800b1b58c842 with Priority: HIGHEST for action port [ 1259.985452] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_rules [ 1259.985668] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1259.985817] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 434de563-bc30-459b-bc37-800b1b58c842 with Priority: HIGHEST for action port [ 1259.986292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.986543] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.986651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.986880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.986970] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.988218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.988218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.988218] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-434de563-bc30-459b-bc37-800b1b58c842 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.988397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-434de563-bc30-459b-bc37-800b1b58c842" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.988397] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-434de563-bc30-459b-bc37-800b1b58c842" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.988481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-434de563-bc30-459b-bc37-800b1b58c842" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.988626] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('434de563-bc30-459b-bc37-800b1b58c842',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.490211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.490829] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.491224] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 434de563-bc30-459b-bc37-800b1b58c842 with status ACTIVE [ 1260.491494] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.491494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.491494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.491707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.491752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.493491] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.493491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.493491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.493491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.493491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.493491] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.493491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.493491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.493491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.493491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.493491] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 434de563-bc30-459b-bc37-800b1b58c842 is going to be updated. [ 1260.514217] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.514348] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.514518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.514624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.514747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.514920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-434de563-bc30-459b-bc37-800b1b58c842" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.883830] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1260.884119] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1260.884158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.884306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.884522] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.884709] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.884822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.884886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.885050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.885132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.885271] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.387269] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.714660] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d in Status: SUCCESS [ 1261.714660] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08b51b44-1df0-4a96-9da8-8c013955ee0d deletion is rescheduled due to dependency. [ 1261.714660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08b51b44-1df0-4a96-9da8-8c013955ee0d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.889461] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.392840] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.392840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.392840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.393104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.393104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.393203] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1262.425430] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.425601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.425649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.425828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.425975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.436539] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1263.095161] env[65899]: INFO networking_nsxv3.common.synchronization [req-e1717d65-ed06-4a6a-a290-8896d7466c5a req-e384b9d6-1e73-40a1-a366-045da42bc93b tempest-ServerActionsV293TestJSON-786500862 tempest-ServerActionsV293TestJSON-786500862-project-member] Enqueued Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_members [ 1263.095679] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_members [ 1263.095828] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.095828] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.095991] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.096385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.096385] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.096385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.096561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.096633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.096666] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.096739] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.415173] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-143 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.415173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-143" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.415173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-143" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.415173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-143" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.415173] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.415173] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.415637] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.415962] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.416245] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.416567] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.416789] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.416991] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.417211] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.417441] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1263.417644] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.417872] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.436579] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.436738] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1263.436874] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.437057] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-143" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.437378] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-c6d871ee-cc7c-4ae0-80f7-81661a47c321 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.437548] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-c6d871ee-cc7c-4ae0-80f7-81661a47c321" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.437667] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-c6d871ee-cc7c-4ae0-80f7-81661a47c321" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.438015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-c6d871ee-cc7c-4ae0-80f7-81661a47c321" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.438171] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6d871ee-cc7c-4ae0-80f7-81661a47c321',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.599077] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.599275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.599386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.599588] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.599695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.599925] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.600078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.600141] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.600306] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.600400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.600535] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd already deleted. [ 1263.600589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.941198] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.941557] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.941769] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.942172] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.942414] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.942607] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port c6d871ee-cc7c-4ae0-80f7-81661a47c321 not found, creating... [ 1263.942926] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.943193] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.943358] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.943648] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.944910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.944910] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.944910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.944910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.944910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.944910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.944910] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: c6d871ee-cc7c-4ae0-80f7-81661a47c321 is going to be created. [ 1263.968589] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.968846] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.968846] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.969309] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.969537] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.969770] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-c6d871ee-cc7c-4ae0-80f7-81661a47c321" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.446261] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1264.446574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.446841] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.447095] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.447325] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.447446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.447512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.447681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.447760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.447843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.447954] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.664373] env[65899]: INFO networking_nsxv3.common.synchronization [req-e1717d65-ed06-4a6a-a290-8896d7466c5a req-01bc8e0a-f40d-4fdc-8d85-7f111fedf72f service nova] Enqueued Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_rules [ 1264.664523] env[65899]: INFO networking_nsxv3.common.synchronization [req-e1717d65-ed06-4a6a-a290-8896d7466c5a req-01bc8e0a-f40d-4fdc-8d85-7f111fedf72f service nova] Enqueued Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_members [ 1264.664657] env[65899]: INFO networking_nsxv3.common.synchronization [req-e1717d65-ed06-4a6a-a290-8896d7466c5a req-01bc8e0a-f40d-4fdc-8d85-7f111fedf72f service nova] Enqueued Resource ID: c6d871ee-cc7c-4ae0-80f7-81661a47c321 with Priority: HIGHEST for action port [ 1264.664910] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_rules [ 1264.665053] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_members [ 1264.665147] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6d871ee-cc7c-4ae0-80f7-81661a47c321 with Priority: HIGHEST for action port [ 1264.665954] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.666710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.666710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.666867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.666947] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.668026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.668026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.668170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.668649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.670357] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.670357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.670357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.670357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.670357] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.670357] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.670825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6d871ee-cc7c-4ae0-80f7-81661a47c321 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.670825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6d871ee-cc7c-4ae0-80f7-81661a47c321" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.670825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6d871ee-cc7c-4ae0-80f7-81661a47c321" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.670825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6d871ee-cc7c-4ae0-80f7-81661a47c321" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.670977] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6d871ee-cc7c-4ae0-80f7-81661a47c321',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.951061] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.951061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.951061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.954387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.954387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.954387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.954387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.954387] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.013643] env[65899]: INFO networking_nsxv3.common.synchronization [req-f2b195f9-edce-4f25-8f13-119a6a0b67fb req-491c1a18-22c3-4fbc-898d-57abc68dc39f tempest-AttachVolumeTestJSON-2123047702 tempest-AttachVolumeTestJSON-2123047702-project-member] Enqueued Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_members [ 1265.014033] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17851c9-16c9-44ea-b660-c316b983e92e with Priority: HIGHEST for action security_group_members [ 1265.014255] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-e17851c9-16c9-44ea-b660-c316b983e92e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.014377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.014442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.014637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.014804] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.014899] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.014960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.015131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.015230] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.015321] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e17851c9-16c9-44ea-b660-c316b983e92e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.173957] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.175632] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.175632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.175896] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6d871ee-cc7c-4ae0-80f7-81661a47c321 with status ACTIVE [ 1265.176058] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.176259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.176326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.176604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.176721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.176976] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.177318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.177407] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.177649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.177817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.178412] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.178412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.178775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.178775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.179046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.179159] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6d871ee-cc7c-4ae0-80f7-81661a47c321 is going to be updated. [ 1265.203411] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.203818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.203971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.204433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.204836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.205130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6d871ee-cc7c-4ae0-80f7-81661a47c321" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.456766] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3990baf0-9e24-4b70-8c31-60cf273fe344: rpc.has_security_group_logging(os_id): False [ 1265.481211] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.481481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.481592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.481847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.482132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.482443] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.482583] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.482668] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.483393] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.483723] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.484198] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.484312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.484430] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.484648] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.484741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.484960] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.485074] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.485138] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.485301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.485420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.485459] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1265.518155] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.518683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.518757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.519054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.519150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.519368] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.519486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.519590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.519776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.519850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.521301] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17851c9-16c9-44ea-b660-c316b983e92e is going to be updated. [ 1265.551574] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.551733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.551804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.552053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.552202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.557057] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.557238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.557238] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.557405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.557564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.563122] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17851c9-16c9-44ea-b660-c316b983e92e in Status: IN_PROGRESS for 2s [ 1265.570897] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1265.676463] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.182602] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.182838] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.182924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.183508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.183508] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.183508] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd is going to be created. [ 1266.211870] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.212079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.212160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.212475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.212682] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.224748] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd in Status: UNINITIALIZED for 2s [ 1267.573724] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e17851c9-16c9-44ea-b660-c316b983e92e in Status: SUCCESS [ 1267.574046] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e17851c9-16c9-44ea-b660-c316b983e92e deletion is rescheduled due to dependency. [ 1267.574046] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e17851c9-16c9-44ea-b660-c316b983e92e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.588730] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1267.588944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.238583] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd in Status: SUCCESS [ 1268.239031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.239339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.239669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.239987] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.240233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.240363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.240646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.240769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.240927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.241117] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.743940] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.247582] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd: rpc.has_security_group_logging(os_id): False [ 1269.268879] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.269159] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.269244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.269515] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.269606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.269869] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.269972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.270061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.271034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.271034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.271034] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd is going to be created. [ 1269.339875] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.340039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.340112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.340406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.340673] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.354683] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd in Status: IN_PROGRESS for 2s [ 1270.015333] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.015613] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1271.371185] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd in Status: SUCCESS [ 1271.371633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.502238] env[65899]: INFO networking_nsxv3.common.synchronization [req-01700b91-273c-4d24-ac5a-41bdcf668d67 req-8a518731-3ff4-44aa-a9d6-9a3983ebef5f tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1273.502715] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1273.502946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.503085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.503145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.503341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.503493] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.503589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.503646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.503787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.503866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.504154] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.855215] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.855489] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.855656] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.856015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.856389] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.856599] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.856754] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.857042] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.857235] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.857498] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1273.857649] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1273.857794] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1273.857938] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1273.858103] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1273.858246] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1273.858436] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1273.880754] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1273.880975] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1273.881170] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1273.881392] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.881792] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-941ad06e-f8e0-4ac3-97df-fba8c17a7533 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.882017] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-941ad06e-f8e0-4ac3-97df-fba8c17a7533" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.882178] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-941ad06e-f8e0-4ac3-97df-fba8c17a7533" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.882609] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-941ad06e-f8e0-4ac3-97df-fba8c17a7533" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.882778] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('941ad06e-f8e0-4ac3-97df-fba8c17a7533',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.007048] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.385632] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.385885] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.385998] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.386346] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.386519] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.386676] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 941ad06e-f8e0-4ac3-97df-fba8c17a7533 not found, creating... [ 1274.386950] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.387127] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.387241] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.387470] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.387612] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.387909] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.388149] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.388289] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.388500] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.388644] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.388787] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 941ad06e-f8e0-4ac3-97df-fba8c17a7533 is going to be created. [ 1274.411278] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.411459] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.411650] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.412035] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.412326] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.412575] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-941ad06e-f8e0-4ac3-97df-fba8c17a7533" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.509460] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.011826] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.011826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.011826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.012022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.012107] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.012204] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1275.043862] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.044063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.044063] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.044706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.044706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.057348] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1275.199685] env[65899]: INFO networking_nsxv3.common.synchronization [req-01700b91-273c-4d24-ac5a-41bdcf668d67 req-6f406bda-203d-4470-a04c-45fb608e3df8 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1275.199924] env[65899]: INFO networking_nsxv3.common.synchronization [req-01700b91-273c-4d24-ac5a-41bdcf668d67 req-6f406bda-203d-4470-a04c-45fb608e3df8 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1275.199999] env[65899]: INFO networking_nsxv3.common.synchronization [req-01700b91-273c-4d24-ac5a-41bdcf668d67 req-6f406bda-203d-4470-a04c-45fb608e3df8 service nova] Enqueued Resource ID: 941ad06e-f8e0-4ac3-97df-fba8c17a7533 with Priority: HIGHEST for action port [ 1275.200635] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1275.200754] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1275.200853] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 941ad06e-f8e0-4ac3-97df-fba8c17a7533 with Priority: HIGHEST for action port [ 1275.201190] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.201264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.201315] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.201598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.201598] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.202451] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.202539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.202723] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-941ad06e-f8e0-4ac3-97df-fba8c17a7533 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.202827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-941ad06e-f8e0-4ac3-97df-fba8c17a7533" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.202888] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-941ad06e-f8e0-4ac3-97df-fba8c17a7533" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.203057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-941ad06e-f8e0-4ac3-97df-fba8c17a7533" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.203245] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('941ad06e-f8e0-4ac3-97df-fba8c17a7533',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.597028] env[65899]: INFO networking_nsxv3.common.synchronization [req-8d08d0dd-61eb-4459-a062-58303fdb3171 req-460d93e6-fdc8-44f4-9836-1be1535974fe tempest-ServersNegativeTestJSON-2131427321 tempest-ServersNegativeTestJSON-2131427321-project-member] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1275.597569] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGHEST for action security_group_members [ 1275.597788] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.597915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.598112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.598197] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.598412] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.598511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.598511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.598699] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.598805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.598914] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.708037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.708037] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 941ad06e-f8e0-4ac3-97df-fba8c17a7533 with status ACTIVE [ 1275.708037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.708037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.708037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.708037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.708680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.708680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.708680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.708680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.708680] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 941ad06e-f8e0-4ac3-97df-fba8c17a7533 is going to be updated. [ 1275.732617] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.732617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.732617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.732617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.732617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.732617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-941ad06e-f8e0-4ac3-97df-fba8c17a7533" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.101477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.101477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.101862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.101862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.101945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.102162] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.102303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.102303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.102463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.102533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.102632] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be updated. [ 1276.134672] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.134924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.134924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.135510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.135510] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.151236] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: IN_PROGRESS for 2s [ 1277.070982] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1277.071749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.071749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.071749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.071952] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.072117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.072215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.073332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.073332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.073332] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.574904] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.896479] env[65899]: INFO networking_nsxv3.common.synchronization [None req-89a0aa57-a7e6-4bcf-a1f0-b69b92ae0e82 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_rules [ 1277.897333] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_rules [ 1277.897333] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.897333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.897549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.897727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.897824] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.984045] env[65899]: INFO networking_nsxv3.common.synchronization [None req-f2acf832-e1d7-4a9e-a33f-3aedadc1f8ec tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_rules [ 1277.984973] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_rules [ 1277.985387] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.985571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.077715] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.161709] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 in Status: SUCCESS [ 1278.161920] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 deletion is rescheduled due to dependency. [ 1278.162044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.424133] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.424388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.424388] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.428168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.428168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.428168] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d already deleted. [ 1278.428168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.428168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.428168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.428168] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.580704] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.581387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.581387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.581387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.581587] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.581587] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1278.616554] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.616680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.616907] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.616978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.617147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.629048] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1278.946536] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.946740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.946740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.946958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.947072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.947147] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d already deleted. [ 1278.947233] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.639767] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1280.640054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.640173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.640443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.640588] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.640703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.640767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.640918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.640998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.641093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.641185] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.143522] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.143742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.143742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.144054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.144250] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.144374] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.144465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.144582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.144671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.144760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.144907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.145048] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.145181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.145272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.145467] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.145467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.145467] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.146761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.146761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.146761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.146761] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.648848] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15353240-f696-445d-9f9f-291a69a12406: rpc.has_security_group_logging(os_id): False [ 1281.666767] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.666767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.666767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.666767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.666767] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.667133] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.667133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.667133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.667269] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.667350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.667518] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.667611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.667698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.667804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.667869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.668063] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.668186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.668245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.668381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.668494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.668536] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1281.726319] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.726593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.726593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.726779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.726981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.744616] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1282.986257] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.986654] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1283.761366] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1283.761731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.171725] env[65899]: INFO networking_nsxv3.common.synchronization [req-a7079de4-ee91-4cda-8d5f-32c12f499370 req-fba96336-7102-47f7-babe-0dbda8cd27b0 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_members [ 1285.171950] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_members [ 1285.172220] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.173909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.173983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.174302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.174462] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.174566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.174629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.174785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.174874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.174971] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.638782] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-443 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.639065] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.639265] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.639578] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.639883] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.640100] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.640262] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.640653] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.640742] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.640962] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1285.641123] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1285.641344] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1285.641492] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1285.641666] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1285.641779] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1285.641943] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1285.662688] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1285.662933] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1285.663124] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1285.663341] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.663689] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-c1973e47-d0ec-4905-93f9-f9f10b57c983 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.663904] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-c1973e47-d0ec-4905-93f9-f9f10b57c983" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.664069] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-c1973e47-d0ec-4905-93f9-f9f10b57c983" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.664462] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-c1973e47-d0ec-4905-93f9-f9f10b57c983" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.664636] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1973e47-d0ec-4905-93f9-f9f10b57c983',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.677055] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.677214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.677257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.677454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.677539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.677720] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.677815] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.677875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.678040] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.678117] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.678262] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d already deleted. [ 1285.678347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.167846] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.168115] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.168391] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.168797] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.169029] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.169313] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port c1973e47-d0ec-4905-93f9-f9f10b57c983 not found, creating... [ 1286.169689] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.169871] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.170106] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.170381] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.170642] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.170953] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.171312] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.171517] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.171736] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.171956] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.172061] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: c1973e47-d0ec-4905-93f9-f9f10b57c983 is going to be created. [ 1286.192730] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.192949] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.193060] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.193352] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.193579] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.193795] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-c1973e47-d0ec-4905-93f9-f9f10b57c983" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.874223] env[65899]: INFO networking_nsxv3.common.synchronization [req-a7079de4-ee91-4cda-8d5f-32c12f499370 req-294fac3a-904e-4fba-8ab9-5f5323cb688a service nova] Enqueued Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_rules [ 1286.874223] env[65899]: INFO networking_nsxv3.common.synchronization [req-a7079de4-ee91-4cda-8d5f-32c12f499370 req-294fac3a-904e-4fba-8ab9-5f5323cb688a service nova] Enqueued Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_members [ 1286.874223] env[65899]: INFO networking_nsxv3.common.synchronization [req-a7079de4-ee91-4cda-8d5f-32c12f499370 req-294fac3a-904e-4fba-8ab9-5f5323cb688a service nova] Enqueued Resource ID: c1973e47-d0ec-4905-93f9-f9f10b57c983 with Priority: HIGHEST for action port [ 1286.874223] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_rules [ 1286.874223] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_members [ 1286.874223] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1973e47-d0ec-4905-93f9-f9f10b57c983 with Priority: HIGHEST for action port [ 1286.874223] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.874223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.874223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.874223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.874223] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.875851] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.876123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.876298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.876926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.877191] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.877405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.877552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.877793] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.879015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.879015] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.879015] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1973e47-d0ec-4905-93f9-f9f10b57c983 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.879015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1973e47-d0ec-4905-93f9-f9f10b57c983" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.880319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1973e47-d0ec-4905-93f9-f9f10b57c983" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.880568] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1973e47-d0ec-4905-93f9-f9f10b57c983" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.880739] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1973e47-d0ec-4905-93f9-f9f10b57c983',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.885217] env[65899]: INFO networking_nsxv3.common.synchronization [req-44faa904-eda4-45df-88d8-11a201a322ba req-bb9feb8d-86e7-463a-9574-9a495147f10d tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1286.885821] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1286.886749] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.887218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.887586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.887958] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.888230] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.888582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.888848] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.889236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.889553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.889724] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.384714] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.385018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.385056] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.386710] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1973e47-d0ec-4905-93f9-f9f10b57c983 with status ACTIVE [ 1287.386895] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.387019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.387084] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.387281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.387368] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.387535] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.387629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.387725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.387912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.387996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.388336] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.388518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.388580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.388762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.388870] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.388969] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1973e47-d0ec-4905-93f9-f9f10b57c983 is going to be updated. [ 1287.391628] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.413049] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.413235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.413278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.413457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.413589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.413739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1973e47-d0ec-4905-93f9-f9f10b57c983" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.887430] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.893324] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.390022] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.390428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.390428] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.390539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.390646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.390749] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d is going to be created. [ 1288.396601] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.396813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.396813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.397007] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.397103] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.397196] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1288.427456] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.427797] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.427924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.428162] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.428420] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.440045] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.440257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.440257] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.440415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.440563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.442171] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d in Status: UNINITIALIZED for 2s [ 1288.448840] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1290.456640] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d in Status: SUCCESS [ 1290.456985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.457160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.457244] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.457593] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.457593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.457746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.457746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.457866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.457902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.457983] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.460932] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1290.461124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.963226] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.466689] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d: rpc.has_security_group_logging(os_id): False [ 1291.486118] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.486311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.486365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.486565] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.486651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.486892] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.486988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.487070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.487254] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.487360] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.487422] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d is going to be created. [ 1291.553548] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.553722] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.553781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.553963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.554170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.565273] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d in Status: IN_PROGRESS for 2s [ 1291.887417] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.887591] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1293.585012] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d in Status: SUCCESS [ 1293.585446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.412717] env[65899]: INFO networking_nsxv3.common.synchronization [req-4695be88-fc5c-4398-8e1e-d199646c7b20 req-ddfad072-5377-43ba-916b-33ce3507872d tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1294.413392] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1294.413726] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.413847] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.413913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.414199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.414383] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.414529] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.414594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.414758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.414943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.415060] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.918508] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.918813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.918813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.919019] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.938973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.938973] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.938973] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.939252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.939387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.941212] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.941212] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1294.964675] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.964675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.964675] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.964978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.965134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.973494] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1296.984139] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1296.984455] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a deletion is rescheduled due to dependency. [ 1296.984455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.320404] env[65899]: INFO networking_nsxv3.common.synchronization [req-08753f10-b5be-4552-8c3f-c615f849700c req-04a57836-14f4-4175-8525-4078f5186b62 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1299.321494] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1299.321494] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.321494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.321494] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.321774] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.321774] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.321862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.321862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.322018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.322222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.322311] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.621072] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.621239] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.621239] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.621499] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.621744] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.621896] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.622179] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.622220] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.622395] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.622617] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1299.622732] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1299.622840] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1299.622946] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1299.623072] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1299.623180] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1299.623306] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1299.643094] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1299.643282] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1299.643422] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1299.643591] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.643892] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-a2de959b-025e-44c4-a304-0ad49d23c69d taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.644072] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-a2de959b-025e-44c4-a304-0ad49d23c69d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.644190] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-a2de959b-025e-44c4-a304-0ad49d23c69d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.644509] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-a2de959b-025e-44c4-a304-0ad49d23c69d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.644646] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2de959b-025e-44c4-a304-0ad49d23c69d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.825393] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.147184] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.147374] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.147503] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.147777] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.147919] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.148077] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port a2de959b-025e-44c4-a304-0ad49d23c69d not found, creating... [ 1300.148380] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.148546] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.148661] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.148875] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.149011] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.149331] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.149474] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.149588] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.149788] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.149910] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.150058] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: a2de959b-025e-44c4-a304-0ad49d23c69d is going to be created. [ 1300.169468] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.169680] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.169804] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.170085] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.170317] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.170526] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-a2de959b-025e-44c4-a304-0ad49d23c69d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.328870] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.607872] env[65899]: INFO networking_nsxv3.common.synchronization [req-7a63bd07-f98e-4054-bf1e-c4bd691bbee9 req-b30b8d47-ed48-4920-948a-73f551259416 tempest-ServerActionsTestOtherB-1521776614 tempest-ServerActionsTestOtherB-1521776614-project-member] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1300.608454] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1300.608811] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.608935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.608935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.609151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.609306] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.609413] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.609481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.609627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.609711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.609802] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.831773] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.832028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.832079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.832351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.832481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.832579] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1300.862249] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.862419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.862505] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.862727] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.862924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.872127] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1300.886168] env[65899]: INFO networking_nsxv3.common.synchronization [req-08753f10-b5be-4552-8c3f-c615f849700c req-c6300056-28a0-4236-99ed-a5f5b115c40c service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1300.886168] env[65899]: INFO networking_nsxv3.common.synchronization [req-08753f10-b5be-4552-8c3f-c615f849700c req-c6300056-28a0-4236-99ed-a5f5b115c40c service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1300.886168] env[65899]: INFO networking_nsxv3.common.synchronization [req-08753f10-b5be-4552-8c3f-c615f849700c req-c6300056-28a0-4236-99ed-a5f5b115c40c service nova] Enqueued Resource ID: a2de959b-025e-44c4-a304-0ad49d23c69d with Priority: HIGHEST for action port [ 1300.886168] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1300.886168] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1300.886168] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2de959b-025e-44c4-a304-0ad49d23c69d with Priority: HIGHEST for action port [ 1300.886168] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.886672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.886672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.886672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.886672] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.887372] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.887462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.887682] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2de959b-025e-44c4-a304-0ad49d23c69d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.887780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2de959b-025e-44c4-a304-0ad49d23c69d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.887842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2de959b-025e-44c4-a304-0ad49d23c69d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.888031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2de959b-025e-44c4-a304-0ad49d23c69d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.888083] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2de959b-025e-44c4-a304-0ad49d23c69d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.002479] env[65899]: INFO networking_nsxv3.common.synchronization [req-9b6d4daf-733f-4423-b36d-034a6a350606 req-52731a61-55fe-4e23-97c8-4f19e425da78 tempest-DeleteServersTestJSON-298786478 tempest-DeleteServersTestJSON-298786478-project-member] Enqueued Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1301.002991] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 with Priority: HIGHEST for action security_group_members [ 1301.003424] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-3990baf0-9e24-4b70-8c31-60cf273fe344 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.003555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.003622] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.003930] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.004734] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.004864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.004933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.005122] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.005211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.005305] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3990baf0-9e24-4b70-8c31-60cf273fe344',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.111360] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.111555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.111611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.111854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.111990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.112226] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.112330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.112395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.112555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.112631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.112713] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1301.138823] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.139039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.139039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.139214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.139386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.147652] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1301.390028] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.391026] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.391026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2de959b-025e-44c4-a304-0ad49d23c69d with status ACTIVE [ 1301.391026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.391219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.391219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.391411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.391500] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.391668] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.391764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.391824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.391970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.392059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.392278] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.392373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.392436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.392589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.392665] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.392748] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2de959b-025e-44c4-a304-0ad49d23c69d is going to be updated. [ 1301.415223] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.415483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.415483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.415623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.415758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.415913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2de959b-025e-44c4-a304-0ad49d23c69d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.507525] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.507780] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.507868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.508121] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.508214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.508452] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.508563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.508617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.508757] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.508966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.508966] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 is going to be updated. [ 1301.601582] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.601785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.601785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.601998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.602160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.610852] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: IN_PROGRESS for 2s [ 1302.882378] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1302.882846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.882846] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.883014] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.883203] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.883439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.883439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.883577] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.883641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.883716] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.157429] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1303.157645] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 deletion is rescheduled due to dependency. [ 1303.157758] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.385738] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.623761] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 in Status: SUCCESS [ 1303.623957] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3990baf0-9e24-4b70-8c31-60cf273fe344 deletion is rescheduled due to dependency. [ 1303.624090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3990baf0-9e24-4b70-8c31-60cf273fe344" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.888313] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.390641] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.390804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.390878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.391152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.391235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.391316] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1304.418870] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.419009] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.419080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.419292] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.419476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.428240] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1304.479184] env[65899]: INFO networking_nsxv3.common.synchronization [req-efb14486-bace-453f-839b-26d582bf06cb req-f4a90cb0-704b-4f8c-9e02-7be4e88ea926 tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1304.479345] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1304.479655] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.479775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.479832] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.480031] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.480238] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.480287] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.480358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.480473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.480554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.480644] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.749879] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.750092] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.750217] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.750479] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.750732] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.750886] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.751015] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.751225] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.751366] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.751600] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1304.751745] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1304.751918] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1304.752096] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1304.752223] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1304.752331] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1304.752461] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1304.771084] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1304.771278] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1304.771421] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1304.771628] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.771954] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-99d1690d-8ac6-49fc-a84c-4374edfddd39 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.772147] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-99d1690d-8ac6-49fc-a84c-4374edfddd39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.772269] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-99d1690d-8ac6-49fc-a84c-4374edfddd39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.772613] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-99d1690d-8ac6-49fc-a84c-4374edfddd39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.772762] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99d1690d-8ac6-49fc-a84c-4374edfddd39',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.983504] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.983919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.983919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.983919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.984068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.984207] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.984285] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.984324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.984463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.984537] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.984621] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1305.011917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.012127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.012218] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.012448] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.012594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.025358] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1305.275455] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.275746] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.275911] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.276236] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.276428] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.276596] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 99d1690d-8ac6-49fc-a84c-4374edfddd39 not found, creating... [ 1305.276866] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.277037] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.277160] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.277381] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.277566] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.277862] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.278636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.278636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.278636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.278636] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.278860] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 99d1690d-8ac6-49fc-a84c-4374edfddd39 is going to be created. [ 1305.300165] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.300382] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.300526] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.300819] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.301052] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.301268] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-99d1690d-8ac6-49fc-a84c-4374edfddd39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.015027] env[65899]: INFO networking_nsxv3.common.synchronization [req-efb14486-bace-453f-839b-26d582bf06cb req-96b73ff5-969f-456b-a106-c07e1f8269cb service nova] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 1306.015323] env[65899]: INFO networking_nsxv3.common.synchronization [req-efb14486-bace-453f-839b-26d582bf06cb req-96b73ff5-969f-456b-a106-c07e1f8269cb service nova] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1306.015367] env[65899]: INFO networking_nsxv3.common.synchronization [req-efb14486-bace-453f-839b-26d582bf06cb req-96b73ff5-969f-456b-a106-c07e1f8269cb service nova] Enqueued Resource ID: 99d1690d-8ac6-49fc-a84c-4374edfddd39 with Priority: HIGHEST for action port [ 1306.015907] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 1306.016066] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1306.016161] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99d1690d-8ac6-49fc-a84c-4374edfddd39 with Priority: HIGHEST for action port [ 1306.016497] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.016627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.016690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.016892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.017022] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.018722] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.018833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.019058] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-99d1690d-8ac6-49fc-a84c-4374edfddd39 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.019178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99d1690d-8ac6-49fc-a84c-4374edfddd39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.019246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99d1690d-8ac6-49fc-a84c-4374edfddd39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.019464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99d1690d-8ac6-49fc-a84c-4374edfddd39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.019555] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99d1690d-8ac6-49fc-a84c-4374edfddd39',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.438612] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1306.438825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.439091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.439312] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.439529] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.439663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.439730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.439887] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.439965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.440068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.440158] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.521516] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.521685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.523013] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99d1690d-8ac6-49fc-a84c-4374edfddd39 with status ACTIVE [ 1306.523192] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.523305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.523367] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.523604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.523696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.523872] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.523968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.524044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.524188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.524263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.524436] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.524528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.524597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.524737] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.524818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.524911] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99d1690d-8ac6-49fc-a84c-4374edfddd39 is going to be updated. [ 1306.546981] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.547261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.547359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.547592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.547748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.547922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99d1690d-8ac6-49fc-a84c-4374edfddd39" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.942118] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.942361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.942361] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.942553] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.942725] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.942830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.942892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.943071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.943166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.943310] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.943476] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.943573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.943637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.943772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.943907] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.943995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.944067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.944199] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.944271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.944349] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.944436] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.034873] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1307.035167] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a deletion is rescheduled due to dependency. [ 1307.035167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.035326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.035541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.035724] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.035836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.035900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.036064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.036144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.036284] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.446933] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15353240-f696-445d-9f9f-291a69a12406: rpc.has_security_group_logging(os_id): False [ 1307.470234] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.470363] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.470411] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.470691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.470833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.471150] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.471281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.471371] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.471580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.471760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.471883] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.471978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.472035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.472186] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.472278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.472522] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.472609] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.472663] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.472801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.472874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.472958] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1307.538922] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.552884] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.553125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.553125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.553341] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.553480] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.570422] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1308.041746] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.544604] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.544866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.544866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.545059] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.545148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.545245] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1308.602710] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.602924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.602924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.603114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.603235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.614297] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1309.585684] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1309.586032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.908577] env[65899]: INFO networking_nsxv3.common.synchronization [req-f1a7e955-83d6-402b-92c5-82f06118233f req-4b00de9a-b9a9-4695-9a4d-14bdf2a3b15e tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 1309.909278] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 1309.909775] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.909775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.910025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.910025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.910167] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.910283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.910337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.910487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.910570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.910678] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.413675] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.624765] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1310.625062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.625298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.629021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.629021] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.629021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.629021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.629021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.629021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.629021] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.629021] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.915980] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.128425] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.419423] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.420128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.420128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.420128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.420319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.420319] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be updated. [ 1311.449307] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.449433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.449479] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.449749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.449839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.467486] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: IN_PROGRESS for 2s [ 1311.631440] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80a77268-fa72-46b8-ba25-eed73b0ba36a: rpc.has_security_group_logging(os_id): False [ 1311.652097] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.652250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.652321] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.652534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.652626] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.652932] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.652987] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.653028] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.653172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.653247] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.653332] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1311.719331] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.719331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.719331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.719331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.719331] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.732801] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1312.917964] env[65899]: INFO networking_nsxv3.common.synchronization [req-fe6a721d-4271-44b2-82df-f1f63bdf628a req-9f71f9de-d02c-4396-9f7a-1a60b52b5bcb tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1312.918328] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1312.918688] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.918817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.918884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.919091] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.919290] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.919342] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.919387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.919567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.919656] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.919750] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.246306] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.246306] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.246306] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.246306] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.246502] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.246627] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.246733] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.247097] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.247097] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.247703] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1313.247703] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1313.247703] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1313.247703] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1313.247703] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1313.247930] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1313.247930] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1313.271625] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1313.271772] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1313.271831] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1313.272105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.272496] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.273061] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.273291] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.273739] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.274682] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.421798] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.477989] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: SUCCESS [ 1313.478222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.750627] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1313.750877] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.776324] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.776555] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.776685] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.776977] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.777140] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.777300] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e not found, creating... [ 1313.777557] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.777708] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.778274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.778274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.778274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.778434] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.778634] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.778750] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.778972] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.782115] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.782349] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e is going to be created. [ 1313.805905] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.806298] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.806435] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.806846] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.808453] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.808703] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.924288] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.426838] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.428412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.428606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.428990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.428990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.428990] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1314.460498] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.460704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.460704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.460921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.461082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.470513] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1314.501899] env[65899]: INFO networking_nsxv3.common.synchronization [req-fe6a721d-4271-44b2-82df-f1f63bdf628a req-f8d630a4-8bc8-4584-afcb-92f45b921672 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1314.502194] env[65899]: INFO networking_nsxv3.common.synchronization [req-fe6a721d-4271-44b2-82df-f1f63bdf628a req-f8d630a4-8bc8-4584-afcb-92f45b921672 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1314.502410] env[65899]: INFO networking_nsxv3.common.synchronization [req-fe6a721d-4271-44b2-82df-f1f63bdf628a req-f8d630a4-8bc8-4584-afcb-92f45b921672 service nova] Enqueued Resource ID: dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e with Priority: HIGHEST for action port [ 1314.502959] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1314.503142] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1314.503272] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e with Priority: HIGHEST for action port [ 1314.503577] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.503717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.503802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.504032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.504134] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.504975] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.505099] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.505323] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.505440] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.505524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.505762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.505879] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.010507] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.010834] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.010834] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e with status ACTIVE [ 1315.012179] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.012179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.012179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.012179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.012179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.012179] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.012179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.012179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.012179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.012179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.012179] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.012909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.012909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.012909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.012909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.012909] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e is going to be updated. [ 1315.036236] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.036433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.036572] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.037030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.037030] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.037190] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbdfdfe5-0acb-4597-a35d-8a4dcd703e9e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.233402] env[65899]: INFO networking_nsxv3.common.synchronization [req-bc2db4a8-d216-40a6-b43f-56c48bb3ab12 req-dae7e649-aa0d-4347-9151-81a2e5fc4bd5 tempest-ServerActionsTestOtherB-1521776614 tempest-ServerActionsTestOtherB-1521776614-project-member] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1315.234211] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1315.234659] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.234855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.234979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.235316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.235915] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.236053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.236124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.236332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.236472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.236587] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.564994] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.565274] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.565433] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.565824] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.566395] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.566681] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.566906] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.567302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.567669] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.567950] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1315.568442] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1315.568684] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1315.569045] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1315.569243] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1315.569401] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1315.569623] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1315.592023] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1315.592023] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1315.592023] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1315.592023] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.592023] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-dde71f88-f0d2-4275-b479-c8f1a540854a taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.592023] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.592023] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.592023] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.592023] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde71f88-f0d2-4275-b479-c8f1a540854a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.739070] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.739248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.739319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.739561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.739660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.739850] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.739946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.739999] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.740172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.740248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.740333] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1315.767234] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.767396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.767396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.767603] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.767760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.776778] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1316.095407] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.095881] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.095881] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.096184] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.096376] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.096565] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port dde71f88-f0d2-4275-b479-c8f1a540854a not found, creating... [ 1316.096888] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.097105] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.097243] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.097598] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.097713] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.098047] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.098246] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.098411] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.098719] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.098886] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.099075] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: dde71f88-f0d2-4275-b479-c8f1a540854a is going to be created. [ 1316.119534] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.119781] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.119858] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.120132] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.120356] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.120573] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.483015] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1316.483319] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.483521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.483976] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.484206] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.484334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.484401] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.484752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.484752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.484869] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.849118] env[65899]: INFO networking_nsxv3.common.synchronization [req-bc2db4a8-d216-40a6-b43f-56c48bb3ab12 req-31e5209a-4bfe-45cd-8173-a4f394f74b1f service nova] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 1316.849270] env[65899]: INFO networking_nsxv3.common.synchronization [req-bc2db4a8-d216-40a6-b43f-56c48bb3ab12 req-31e5209a-4bfe-45cd-8173-a4f394f74b1f service nova] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1316.849377] env[65899]: INFO networking_nsxv3.common.synchronization [req-bc2db4a8-d216-40a6-b43f-56c48bb3ab12 req-31e5209a-4bfe-45cd-8173-a4f394f74b1f service nova] Enqueued Resource ID: dde71f88-f0d2-4275-b479-c8f1a540854a with Priority: HIGHEST for action port [ 1316.850199] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 1316.850371] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1316.850528] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde71f88-f0d2-4275-b479-c8f1a540854a with Priority: HIGHEST for action port [ 1316.850917] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.851066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.851135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.851334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.851547] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.852425] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.852524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.852752] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde71f88-f0d2-4275-b479-c8f1a540854a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.852879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.852957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.853938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.853938] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde71f88-f0d2-4275-b479-c8f1a540854a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.987516] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.356082] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.356082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.356082] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dde71f88-f0d2-4275-b479-c8f1a540854a with status ACTIVE [ 1317.356082] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.356082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.356082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.356082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.356082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.356821] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.356821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.356821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.356821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.356821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.356821] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.357056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.357056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.357120] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.357153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.357227] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dde71f88-f0d2-4275-b479-c8f1a540854a is going to be updated. [ 1317.383811] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.384073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.384073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.384177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.384316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.384472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.490871] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.788411] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1317.788631] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 deletion is rescheduled due to dependency. [ 1317.788681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.789263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.789263] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.789374] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.789439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.789476] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.790061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.790061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.790061] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.994327] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.994327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.994327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.994327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.994327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.994327] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1318.025804] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.026082] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.026146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.026352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.026499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.035862] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1318.292618] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.796868] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.299381] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.299592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.299592] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.299830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.299978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.300104] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1319.334046] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.334373] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.334446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.334741] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.334975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.345048] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1320.047027] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1320.047327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.047866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.047866] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.047866] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.048112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.048112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.048112] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.048215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.048271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.048364] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.550754] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.550972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.551062] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.551273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.551481] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.551593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.551657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.551822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.551935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.552102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.552346] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.552453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.552516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.552683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.552829] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.552941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.553020] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.553161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.553236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.553313] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.553401] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.055913] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15353240-f696-445d-9f9f-291a69a12406: rpc.has_security_group_logging(os_id): False [ 1321.074732] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.074913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.074963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.075232] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.075328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.075545] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.075651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.075708] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.075843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.075912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.076114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.076221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.076281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.076399] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.076488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.076680] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.076782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.076845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.076956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.077029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.077141] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1321.137976] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.138144] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.138213] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.138408] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.138591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.169167] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1321.354849] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1321.355077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.355382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.355617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.355816] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.355938] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.356009] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.356245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.356300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.356344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.356443] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.743760] env[65899]: INFO networking_nsxv3.common.synchronization [req-09b9f4f0-8232-4546-9bd6-5f8d882ddf50 req-bead8b48-ea0b-498d-9b48-d3cbccc50913 tempest-ServerActionsV293TestJSON-786500862 tempest-ServerActionsV293TestJSON-786500862-project-member] Enqueued Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_members [ 1321.744375] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd with Priority: HIGHEST for action security_group_members [ 1321.744691] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.744850] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.744933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.745148] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.745309] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.745433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.745477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.745625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.745707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.745800] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.858986] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.248832] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.249248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.249248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.249346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.249346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.249590] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.249743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.249743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.249894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.249970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.250073] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd is going to be updated. [ 1322.283422] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.283657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.283706] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.283971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.284168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.294118] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd in Status: IN_PROGRESS for 2s [ 1322.362321] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d97c0b7d-58d1-4baf-97be-f3a035518398: rpc.has_security_group_logging(os_id): False [ 1322.381127] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.381127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.381127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.381127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.381127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.381127] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.381127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.381127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.381423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.381423] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.381423] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1322.450033] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.450033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.450033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.450033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.450033] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.461688] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1323.189541] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1323.189831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.305214] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd in Status: SUCCESS [ 1324.305602] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd deletion is rescheduled due to dependency. [ 1324.305602] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.430668] env[65899]: INFO networking_nsxv3.common.synchronization [req-c71e6ce1-7d86-4f8e-a346-766de617d017 req-134fcf3d-2f54-45c2-9045-a7f18d9ad428 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1324.431212] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1324.431533] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.431651] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.431711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.431912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.432071] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.432172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.432284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.432455] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.432545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.432642] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.477821] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1324.477821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.935247] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.437511] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.939822] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.940079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.940079] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.940291] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.940382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.940482] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1325.969101] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.969260] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.969307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.969498] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.969734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.978856] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1328.002449] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1328.002873] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.432059] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.432487] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.532790] env[65899]: INFO networking_nsxv3.common.synchronization [req-2b8aab71-665a-4571-bbf4-ef96df1063af req-472dcd6a-9cd7-4d02-9b1a-df23d3dd725b tempest-ServerActionsTestOtherA-1550951506 tempest-ServerActionsTestOtherA-1550951506-project-member] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 1329.533547] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGHEST for action security_group_members [ 1329.533630] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.533749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.533839] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.534013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.534168] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.534265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.534324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.534478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.534559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.534648] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.036383] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.036590] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.036638] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.036924] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.037036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.037260] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.037365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.037429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.037578] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.037654] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.037739] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be updated. [ 1330.067496] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.067704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.067785] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.068050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.068208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.079965] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: IN_PROGRESS for 2s [ 1331.149434] env[65899]: INFO networking_nsxv3.common.synchronization [req-6a4d14bb-2976-447b-85ef-a08875c012e7 req-112bf71e-59c4-4675-bb6f-d12901573091 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1331.150267] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1331.151037] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.151037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.151364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.151364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.151633] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.151807] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.151911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.152181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.152314] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.152479] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.656349] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.092906] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c in Status: SUCCESS [ 1332.093152] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c deletion is rescheduled due to dependency. [ 1332.093271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.158881] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.661572] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.661739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.661808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.662105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.662203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.662304] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1332.703900] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.703900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.703900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.703900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.703900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.714555] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1334.725304] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1334.725620] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.291719] env[65899]: INFO networking_nsxv3.common.synchronization [req-148f8e75-0c76-41bb-88ab-f935982283d6 req-426f7b60-c3d9-42f3-89da-c3e524dc5814 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_members [ 1335.292335] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGHEST for action security_group_members [ 1335.292649] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.292772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.293369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.293369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.293369] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.293369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.293369] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.293605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.293605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.293605] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.796068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.796068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.796068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.796068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.796068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.796477] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.796477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.796477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.796477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.796611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.796611] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d is going to be updated. [ 1335.826063] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.826324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.826463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.826715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.826867] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.835696] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d in Status: IN_PROGRESS for 2s [ 1337.289644] env[65899]: INFO networking_nsxv3.common.synchronization [None req-17a01fe5-c864-4acc-a1a0-bf46896c2364 None None] Enqueued Resource ID: 90653bf3-b36f-4e63-8d87-5107b20510fe with Priority: HIGHEST for action port [ 1337.290192] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90653bf3-b36f-4e63-8d87-5107b20510fe with Priority: HIGHEST for action port [ 1337.290497] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-90653bf3-b36f-4e63-8d87-5107b20510fe taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.290631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90653bf3-b36f-4e63-8d87-5107b20510fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.290684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90653bf3-b36f-4e63-8d87-5107b20510fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.290977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90653bf3-b36f-4e63-8d87-5107b20510fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.291072] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90653bf3-b36f-4e63-8d87-5107b20510fe',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.794833] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90653bf3-b36f-4e63-8d87-5107b20510fe [ 1337.794833] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.794833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.794833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.794833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.794833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.794833] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90653bf3-b36f-4e63-8d87-5107b20510fe already deleted. [ 1337.794833] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90653bf3-b36f-4e63-8d87-5107b20510fe" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.847347] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d in Status: SUCCESS [ 1337.847520] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d deletion is rescheduled due to dependency. [ 1337.847631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.504393] env[65899]: INFO networking_nsxv3.common.synchronization [None req-7205b890-56f7-4178-bcb5-e4604bc1fdd3 None None] Enqueued Resource ID: 198a9c06-9758-4355-8073-3edbd4a07960 with Priority: HIGHEST for action port [ 1339.504944] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198a9c06-9758-4355-8073-3edbd4a07960 with Priority: HIGHEST for action port [ 1339.505247] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-198a9c06-9758-4355-8073-3edbd4a07960 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.505368] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-198a9c06-9758-4355-8073-3edbd4a07960" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.505433] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-198a9c06-9758-4355-8073-3edbd4a07960" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.505676] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-198a9c06-9758-4355-8073-3edbd4a07960" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.505756] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('198a9c06-9758-4355-8073-3edbd4a07960',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.009478] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 198a9c06-9758-4355-8073-3edbd4a07960 [ 1340.009645] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.009779] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.009849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.010102] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.010195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.010287] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:198a9c06-9758-4355-8073-3edbd4a07960 already deleted. [ 1340.010365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-198a9c06-9758-4355-8073-3edbd4a07960" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.598721] env[65899]: INFO networking_nsxv3.common.synchronization [req-bf990466-4319-4eab-a79f-bcb1a0c2ed9b req-88339700-3937-4864-9d3e-c2797eeca0c5 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1341.599201] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1341.599632] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.599886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.600036] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.600246] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.600510] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.600691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.601094] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.601226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.601372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.601586] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.922216] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.922417] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.922541] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.922811] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.923078] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.923233] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.923348] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.923579] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.923728] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.923937] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1341.924063] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1341.924176] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1341.924283] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1341.924393] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1341.924498] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1341.924624] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1341.945336] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1341.945502] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1341.945638] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1341.945807] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.946126] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.946297] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.946414] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.946732] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.946871] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9f6b37b-f06b-4b09-86ca-2fff3c841a1e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.104481] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.449080] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.449333] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.449440] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.449719] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.449944] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.450130] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port b9f6b37b-f06b-4b09-86ca-2fff3c841a1e not found, creating... [ 1342.450393] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.450548] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.450663] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.450915] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.451042] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.451327] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.451479] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.451595] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.451800] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.451934] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.452081] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: b9f6b37b-f06b-4b09-86ca-2fff3c841a1e is going to be created. [ 1342.475213] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.475442] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.475525] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.475821] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.476077] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.476302] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.607054] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.109536] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.109710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.109792] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.110039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.110136] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.110236] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1343.141772] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.141772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.141772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.141772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.141772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.152690] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1343.176266] env[65899]: INFO networking_nsxv3.common.synchronization [req-bf990466-4319-4eab-a79f-bcb1a0c2ed9b req-53aa8c51-c198-4112-8803-56bacde77db4 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1343.176436] env[65899]: INFO networking_nsxv3.common.synchronization [req-bf990466-4319-4eab-a79f-bcb1a0c2ed9b req-53aa8c51-c198-4112-8803-56bacde77db4 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1343.176571] env[65899]: INFO networking_nsxv3.common.synchronization [req-bf990466-4319-4eab-a79f-bcb1a0c2ed9b req-53aa8c51-c198-4112-8803-56bacde77db4 service nova] Enqueued Resource ID: b9f6b37b-f06b-4b09-86ca-2fff3c841a1e with Priority: HIGHEST for action port [ 1343.177116] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1343.177277] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1343.177350] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9f6b37b-f06b-4b09-86ca-2fff3c841a1e with Priority: HIGHEST for action port [ 1343.177623] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.178187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.178187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.178187] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.178187] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.178926] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.179077] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.179223] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.179330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.179450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.179519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.179584] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9f6b37b-f06b-4b09-86ca-2fff3c841a1e',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.681445] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.681747] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.681800] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9f6b37b-f06b-4b09-86ca-2fff3c841a1e with status ACTIVE [ 1343.681952] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.682070] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.682133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.682339] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.682426] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.682591] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.682685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.682751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.682886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.682963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.683191] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.683270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.683307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.683439] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.683509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.683589] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9f6b37b-f06b-4b09-86ca-2fff3c841a1e is going to be updated. [ 1343.709076] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.709217] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.709293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.709496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.709633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.709786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9f6b37b-f06b-4b09-86ca-2fff3c841a1e" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.742867] env[65899]: INFO networking_nsxv3.common.synchronization [req-a8801dbb-290a-47d1-9061-e0df1abb8fb1 req-38d8dd35-29b8-4e3b-878c-113d7324e8c8 tempest-ServerPasswordTestJSON-515318508 tempest-ServerPasswordTestJSON-515318508-project-member] Enqueued Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGHEST for action security_group_members [ 1343.743400] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGHEST for action security_group_members [ 1343.743695] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d9d9765-c2f1-49df-8133-e3911f01267b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.743814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.743880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.744143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.744329] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.744434] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.744495] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.744649] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.744733] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.744824] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.033125] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-605 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.033323] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-605" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.033520] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-605" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.033802] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-605" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.034043] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.034208] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.034322] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.034538] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.034680] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.034881] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1344.034993] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1344.035118] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1344.035220] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1344.035335] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1344.035430] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1344.035544] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1344.053304] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1344.053471] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1344.053607] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1344.053779] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-605" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.054124] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-f500387c-2c8b-425d-b755-1c5fff9cc4aa taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.054673] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-f500387c-2c8b-425d-b755-1c5fff9cc4aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.054673] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-f500387c-2c8b-425d-b755-1c5fff9cc4aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.054864] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-f500387c-2c8b-425d-b755-1c5fff9cc4aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.055035] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f500387c-2c8b-425d-b755-1c5fff9cc4aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.246904] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.247085] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.247155] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.247366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.247456] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.247649] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.247743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.247804] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.247952] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.248058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.248155] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d9d9765-c2f1-49df-8133-e3911f01267b already deleted. [ 1344.248239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.556921] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.557169] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.557293] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.557566] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.557710] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.557862] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port f500387c-2c8b-425d-b755-1c5fff9cc4aa not found, creating... [ 1344.558135] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.558437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.558437] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.558849] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.558849] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.559838] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.559838] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.559838] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.559838] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.559838] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.559838] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: f500387c-2c8b-425d-b755-1c5fff9cc4aa is going to be created. [ 1344.579243] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.579473] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.579576] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.579828] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.580070] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.580283] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-f500387c-2c8b-425d-b755-1c5fff9cc4aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.162955] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1345.163227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.163351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.163558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.163742] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.163854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.163920] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.164078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.164158] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.164246] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.304497] env[65899]: INFO networking_nsxv3.common.synchronization [req-a8801dbb-290a-47d1-9061-e0df1abb8fb1 req-875c5bc1-9a32-4a97-b8f7-d87b589033ae service nova] Enqueued Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGHEST for action security_group_rules [ 1345.304687] env[65899]: INFO networking_nsxv3.common.synchronization [req-a8801dbb-290a-47d1-9061-e0df1abb8fb1 req-875c5bc1-9a32-4a97-b8f7-d87b589033ae service nova] Enqueued Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGHEST for action security_group_members [ 1345.304828] env[65899]: INFO networking_nsxv3.common.synchronization [req-a8801dbb-290a-47d1-9061-e0df1abb8fb1 req-875c5bc1-9a32-4a97-b8f7-d87b589033ae service nova] Enqueued Resource ID: f500387c-2c8b-425d-b755-1c5fff9cc4aa with Priority: HIGHEST for action port [ 1345.305412] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGHEST for action security_group_rules [ 1345.305572] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGHEST for action security_group_members [ 1345.305683] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f500387c-2c8b-425d-b755-1c5fff9cc4aa with Priority: HIGHEST for action port [ 1345.305963] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d9d9765-c2f1-49df-8133-e3911f01267b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.306166] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.306248] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.306530] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.306640] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.307589] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d9d9765-c2f1-49df-8133-e3911f01267b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.307711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.307787] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.307963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.308142] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.308243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.308307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.308472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.308559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.308669] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.309533] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-f500387c-2c8b-425d-b755-1c5fff9cc4aa taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.309669] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f500387c-2c8b-425d-b755-1c5fff9cc4aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.309726] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f500387c-2c8b-425d-b755-1c5fff9cc4aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.309900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f500387c-2c8b-425d-b755-1c5fff9cc4aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.309980] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f500387c-2c8b-425d-b755-1c5fff9cc4aa',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.666713] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.811536] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.812681] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d9d9765-c2f1-49df-8133-e3911f01267b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.812819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.813260] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f500387c-2c8b-425d-b755-1c5fff9cc4aa with status ACTIVE [ 1345.813436] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.813546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.813658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.813831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.813921] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.814110] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.814274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.814274] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.814684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.814684] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.814684] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.814901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.814901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.814965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.815013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.815078] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f500387c-2c8b-425d-b755-1c5fff9cc4aa is going to be updated. [ 1345.836438] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.836655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.836655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.836946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.837110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.837271] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f500387c-2c8b-425d-b755-1c5fff9cc4aa" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.168961] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.313866] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.649100] env[65899]: INFO networking_nsxv3.common.synchronization [req-6b4efae7-d4f2-4f2a-b8eb-31583af510d3 req-04df6af3-6651-4bdc-b4af-b0efa7077f8a tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_members [ 1346.649629] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGHEST for action security_group_members [ 1346.649976] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.650135] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.650179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.650343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.650500] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.650598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.650657] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.650805] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.650884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.651459] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.671353] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.671471] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.671532] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.671725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.671806] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.671898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1346.699292] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.699464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.699511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.699710] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.699854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.709175] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1346.816147] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.816325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.816432] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.816685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.816808] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.816918] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d9d9765-c2f1-49df-8133-e3911f01267b is going to be created. [ 1346.840597] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.840988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.840988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.841137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.841243] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.868981] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d9d9765-c2f1-49df-8133-e3911f01267b in Status: UNINITIALIZED for 2s [ 1347.153448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.153752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.153752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.154101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.154231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.154440] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.154561] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.154658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.154851] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.154928] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.155106] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 is going to be updated. [ 1347.183505] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.183981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.183981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.183981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.184208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.192576] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 in Status: IN_PROGRESS for 2s [ 1348.718811] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1348.719307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.719307] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.719519] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.719711] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.719825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.719895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.720064] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.720149] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.720229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.720317] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.878488] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d9d9765-c2f1-49df-8133-e3911f01267b in Status: SUCCESS [ 1348.878769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.878901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.879226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.879435] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.879558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.879616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.879789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.879874] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.879965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.880104] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.202831] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 in Status: SUCCESS [ 1349.203224] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 deletion is rescheduled due to dependency. [ 1349.203224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.222744] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.222894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.222966] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.223237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.223407] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.223509] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.223567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.223719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.223825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.223946] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.224078] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.224178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.224237] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.224378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.224536] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.224632] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.224685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.224825] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.224900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.224982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.225164] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.382434] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d9d9765-c2f1-49df-8133-e3911f01267b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.382653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.382653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.382852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.383016] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.383110] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.383165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.383314] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.383400] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.383485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.383626] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d9d9765-c2f1-49df-8133-e3911f01267b taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.383717] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.383772] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.383906] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.384053] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.384143] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.384206] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.384329] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.384398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.384475] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.384562] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.727750] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15353240-f696-445d-9f9f-291a69a12406: rpc.has_security_group_logging(os_id): False [ 1349.746278] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.746444] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.746516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.746729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.746819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.747096] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.747215] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.747279] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.747461] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.747541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.747727] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.747821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.747881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.748060] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.748152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.748343] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.748458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.748523] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.748664] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.748736] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.748821] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1349.802768] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1349.803057] env[65899]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-04bbb490-407a-46a5-ac44-20d9d717014c None None] NSXv3 Agent Agent loop - iteration:3 started [ 1349.813811] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.813996] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.814065] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.814283] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.814427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.831467] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1349.886765] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d9d9765-c2f1-49df-8133-e3911f01267b: rpc.has_security_group_logging(os_id): False [ 1349.904440] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.904647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.904647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.904844] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.904940] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.905162] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.905264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.905325] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.905473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.905549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.905719] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.905810] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.905869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.906056] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.906127] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.906322] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.906405] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.906463] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.906604] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.906670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.906752] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d9d9765-c2f1-49df-8133-e3911f01267b is going to be created. [ 1349.972197] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.972445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.972445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.972559] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.972719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.984696] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d9d9765-c2f1-49df-8133-e3911f01267b in Status: IN_PROGRESS for 2s [ 1351.417072] env[65899]: INFO networking_nsxv3.common.synchronization [None req-c49717a2-e205-4bb3-9f82-8927a32539c0 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_rules [ 1351.417582] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_rules [ 1351.417891] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.418053] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.418125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.418412] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.418508] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.500074] env[65899]: INFO networking_nsxv3.common.synchronization [None req-ae12e81b-f163-4ec6-937c-44fb0103e81e tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_rules [ 1351.500435] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_rules [ 1351.500710] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.500813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.851081] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1351.851802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.939160] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.939359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.939359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.939748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.939748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.939748] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05fe27ed-0f48-4824-843a-cb10730b7531 already deleted. [ 1351.939748] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.940382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.940382] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.940382] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.996267] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d9d9765-c2f1-49df-8133-e3911f01267b in Status: SUCCESS [ 1351.996716] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.461454] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.461454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.461454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.461831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.461831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.461946] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05fe27ed-0f48-4824-843a-cb10730b7531 already deleted. [ 1352.462086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.232981] env[65899]: INFO networking_nsxv3.common.synchronization [req-9848ad87-ed0c-4375-a76b-6abec13c4215 req-4d4b2453-6819-4e17-8da2-b8a8f349a064 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1354.233530] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1354.233888] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.234016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.234105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.234272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.234410] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.234499] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.234570] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.234696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.234769] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.234860] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.738009] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.861144] env[65899]: INFO networking_nsxv3.common.synchronization [req-bf8bcae0-857f-462b-a5e9-663dcf4101de req-3a6780da-7fbe-405e-9b1b-73b3a1fedfad tempest-ServerPasswordTestJSON-515318508 tempest-ServerPasswordTestJSON-515318508-project-member] Enqueued Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGHEST for action security_group_members [ 1354.861777] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGHEST for action security_group_members [ 1354.862122] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d9d9765-c2f1-49df-8133-e3911f01267b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.862249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.862318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.863236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.863421] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.863533] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.863598] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.863775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.863858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.863952] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.240973] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.366364] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.366574] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.366623] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.366816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.366905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.367142] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.367245] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.367317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.367446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.367520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.367606] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d9d9765-c2f1-49df-8133-e3911f01267b is going to be updated. [ 1355.394965] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.395161] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.395250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.395457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.395600] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.403397] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d9d9765-c2f1-49df-8133-e3911f01267b in Status: IN_PROGRESS for 2s [ 1355.743949] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.744177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.744177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.744337] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.744424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.744522] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1355.772180] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.772365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.772414] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.772605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.772746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.788719] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1357.413014] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d9d9765-c2f1-49df-8133-e3911f01267b in Status: SUCCESS [ 1357.413431] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d9d9765-c2f1-49df-8133-e3911f01267b deletion is rescheduled due to dependency. [ 1357.413558] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.802244] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1357.802465] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.006776] env[65899]: INFO networking_nsxv3.common.synchronization [req-71f8950a-30e9-4ff9-ab4b-b79e18460415 req-c329da77-5cab-4fe3-8c66-2ad32240b7fa tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_members [ 1358.007402] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_members [ 1358.007719] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.007845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.007912] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.008201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.008364] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.008460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.008521] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.008674] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.008945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.008945] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.315757] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-443 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.315956] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.316092] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.316353] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.316603] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.316786] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.316852] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.317119] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.317261] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.317465] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1358.317599] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1358.317721] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1358.317837] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1358.317949] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1358.318652] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1358.318652] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1358.338719] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1358.338904] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1358.339042] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1358.339231] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.339552] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.339720] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.339831] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.340186] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.340322] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec6fd1aa-bc89-457f-a7ce-3a2124ed7352',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.511272] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.511645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.511645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.511730] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.511824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.511972] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.512087] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.512150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.512302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.512377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.512458] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05fe27ed-0f48-4824-843a-cb10730b7531 already deleted. [ 1358.512535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.843135] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.843431] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.843609] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.844041] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.844288] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.844557] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port ec6fd1aa-bc89-457f-a7ce-3a2124ed7352 not found, creating... [ 1358.844943] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.845217] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.845442] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.845806] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.845976] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.846404] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.846628] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.846766] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.847081] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.847318] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.847555] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: ec6fd1aa-bc89-457f-a7ce-3a2124ed7352 is going to be created. [ 1358.867872] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.868106] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.868235] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.868908] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.869256] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.869572] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.583020] env[65899]: INFO networking_nsxv3.common.synchronization [req-71f8950a-30e9-4ff9-ab4b-b79e18460415 req-4a4d32f0-de2f-41fe-a149-b657d175e9df service nova] Enqueued Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_rules [ 1359.583020] env[65899]: INFO networking_nsxv3.common.synchronization [req-71f8950a-30e9-4ff9-ab4b-b79e18460415 req-4a4d32f0-de2f-41fe-a149-b657d175e9df service nova] Enqueued Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_members [ 1359.583020] env[65899]: INFO networking_nsxv3.common.synchronization [req-71f8950a-30e9-4ff9-ab4b-b79e18460415 req-4a4d32f0-de2f-41fe-a149-b657d175e9df service nova] Enqueued Resource ID: ec6fd1aa-bc89-457f-a7ce-3a2124ed7352 with Priority: HIGHEST for action port [ 1359.583020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_rules [ 1359.583020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_members [ 1359.583020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec6fd1aa-bc89-457f-a7ce-3a2124ed7352 with Priority: HIGHEST for action port [ 1359.583788] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.586995] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.586995] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.586995] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.586995] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.586995] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.588523] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.588879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.589068] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.589351] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.589540] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec6fd1aa-bc89-457f-a7ce-3a2124ed7352',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.092240] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.092680] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec6fd1aa-bc89-457f-a7ce-3a2124ed7352 with status ACTIVE [ 1360.093026] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.093235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.094078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.094078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.094078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.094273] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.094332] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.094459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.094729] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.094941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.095222] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.095392] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.095453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.095671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.095836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.095980] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec6fd1aa-bc89-457f-a7ce-3a2124ed7352 is going to be updated. [ 1360.097621] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.097766] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.117825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.118029] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.118100] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.118249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.118384] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.118538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec6fd1aa-bc89-457f-a7ce-3a2124ed7352" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.599666] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.101787] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.102018] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.102114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.102350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.102449] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.102550] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05fe27ed-0f48-4824-843a-cb10730b7531 is going to be created. [ 1361.128513] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.128661] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.128731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.128963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.129172] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.138934] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05fe27ed-0f48-4824-843a-cb10730b7531 in Status: UNINITIALIZED for 2s [ 1363.150640] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05fe27ed-0f48-4824-843a-cb10730b7531 in Status: SUCCESS [ 1363.151539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.151539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.151539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.151539] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.151539] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.151738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.151738] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.151813] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.151858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.151985] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.654163] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.158307] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05fe27ed-0f48-4824-843a-cb10730b7531: rpc.has_security_group_logging(os_id): False [ 1364.176714] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.176890] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.176947] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.177224] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.177354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.177639] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.177784] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.177894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.178125] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.178252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.178389] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05fe27ed-0f48-4824-843a-cb10730b7531 is going to be created. [ 1364.239553] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.239786] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.239905] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.240067] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.240252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.258900] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05fe27ed-0f48-4824-843a-cb10730b7531 in Status: IN_PROGRESS for 2s [ 1364.583751] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.583945] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1366.272896] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05fe27ed-0f48-4824-843a-cb10730b7531 in Status: SUCCESS [ 1366.273317] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.366401] env[65899]: INFO networking_nsxv3.common.synchronization [req-77bf9226-730d-4f18-abd0-90d92eb39360 req-2eb5024d-f771-42b1-886f-4b5122839296 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1366.366947] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1366.367258] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.367624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.367624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.367624] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.367773] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.367876] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.367933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.368225] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.368316] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.368426] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.649076] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-735 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.649245] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.649470] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.649772] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.650081] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.650299] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.650448] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.650715] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.650922] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.651095] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1366.651210] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1366.651318] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1366.651418] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1366.651523] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1366.651624] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1366.651751] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1366.669514] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1366.669689] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1366.669824] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1366.669973] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-735" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.670326] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-a1f12fb4-12c0-4308-8008-4dc4411d2918 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.670514] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-a1f12fb4-12c0-4308-8008-4dc4411d2918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.670613] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-a1f12fb4-12c0-4308-8008-4dc4411d2918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.670942] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-a1f12fb4-12c0-4308-8008-4dc4411d2918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.671339] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1f12fb4-12c0-4308-8008-4dc4411d2918',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.870556] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.173373] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.173601] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.173710] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.174010] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.174261] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.174316] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port a1f12fb4-12c0-4308-8008-4dc4411d2918 not found, creating... [ 1367.174580] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.174752] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.175112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.175112] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.175225] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.175521] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.175676] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.175789] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.175999] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.176236] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.176398] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: a1f12fb4-12c0-4308-8008-4dc4411d2918 is going to be created. [ 1367.197709] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.198103] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.198234] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.198474] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.198706] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.199025] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-a1f12fb4-12c0-4308-8008-4dc4411d2918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.373714] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.878979] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.879222] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.879326] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.879688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.879854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.880055] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1367.918224] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.918478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.918538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.918856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.919177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.937823] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1367.985077] env[65899]: INFO networking_nsxv3.common.synchronization [req-77bf9226-730d-4f18-abd0-90d92eb39360 req-a30d6e86-14af-4872-b6c9-74e9ca64f887 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1367.985268] env[65899]: INFO networking_nsxv3.common.synchronization [req-77bf9226-730d-4f18-abd0-90d92eb39360 req-a30d6e86-14af-4872-b6c9-74e9ca64f887 service nova] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1367.985407] env[65899]: INFO networking_nsxv3.common.synchronization [req-77bf9226-730d-4f18-abd0-90d92eb39360 req-a30d6e86-14af-4872-b6c9-74e9ca64f887 service nova] Enqueued Resource ID: a1f12fb4-12c0-4308-8008-4dc4411d2918 with Priority: HIGHEST for action port [ 1367.985944] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_rules [ 1367.986098] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1367.986194] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f12fb4-12c0-4308-8008-4dc4411d2918 with Priority: HIGHEST for action port [ 1367.986470] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.986589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.986653] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.986855] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.986935] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.989204] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.989333] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.990748] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1f12fb4-12c0-4308-8008-4dc4411d2918 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.990896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1f12fb4-12c0-4308-8008-4dc4411d2918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.990967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1f12fb4-12c0-4308-8008-4dc4411d2918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.991226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1f12fb4-12c0-4308-8008-4dc4411d2918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.991275] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1f12fb4-12c0-4308-8008-4dc4411d2918',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.495941] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.496381] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.496595] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1f12fb4-12c0-4308-8008-4dc4411d2918 with status ACTIVE [ 1368.496883] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.497220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.497355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.497625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.497751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.498014] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.498167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.498289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.498473] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.498581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.498843] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.498975] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.499076] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.499354] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.499458] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.499573] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1f12fb4-12c0-4308-8008-4dc4411d2918 is going to be updated. [ 1368.523675] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.523949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.523949] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.524123] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.524278] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.524462] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1f12fb4-12c0-4308-8008-4dc4411d2918" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.948060] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1369.948464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.948512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.948749] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.948981] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.949154] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.949221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.949385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.949466] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.949581] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.451635] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.953771] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.456381] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.456597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.456597] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.456822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.456910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.457026] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1371.491883] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.492050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.492124] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.492364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.492524] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.501911] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1372.987252] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.987706] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1373.513941] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1373.514297] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.514362] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.514541] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.514748] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.514869] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.514945] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.515096] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.515185] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.515250] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.515349] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.017770] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.018265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.018265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.018265] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.018416] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.018983] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.019090] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.019303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.019452] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.019491] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.019636] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.019719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.019768] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.019919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.020068] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.020152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.020205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.020343] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.020416] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.020589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.020681] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.523275] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15353240-f696-445d-9f9f-291a69a12406: rpc.has_security_group_logging(os_id): False [ 1374.541296] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.541531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.541531] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.541781] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.541875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.542114] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.542241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.542300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.542442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.542518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.542697] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.542782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.542842] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.543011] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.543093] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.543286] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.543378] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.543437] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.543605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.543740] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.543783] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1374.610428] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.610691] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.610753] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.610978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.611202] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.631235] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1376.652890] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1376.653344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.988750] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.989140] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.569520] env[65899]: INFO networking_nsxv3.common.synchronization [req-96457b35-5703-47b0-a33c-c5725da9c9c5 req-05317f1f-62b0-472c-ac31-40e4d897a907 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1381.569520] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1381.569520] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.569860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.569860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.569860] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.569981] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.570451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.570554] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.570742] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.570831] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.570937] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.074157] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.576981] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.079938] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.080130] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.080189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.080422] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.080535] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.080598] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1383.118841] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.119035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.119104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.119300] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.119454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.127498] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1385.138695] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1385.138977] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.737388] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.737641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.737641] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.737840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.737942] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.240470] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.570275] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.570451] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.743268] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.245607] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1387.245980] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1387.479912] env[65899]: INFO networking_nsxv3.common.synchronization [req-7e2c9030-7fd4-41cb-b0b8-2898b143fbb6 req-66077455-cc18-43e8-ab73-d939ecfe74c7 tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1387.480474] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1387.480780] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.480901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.481009] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.481303] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.481464] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.481573] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.481631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.481801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.481883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.481982] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.895253] env[65899]: INFO networking_nsxv3.common.synchronization [req-24cf703d-b5e4-4352-9051-e081ccfceae1 req-0e62e3cd-0c75-4881-980d-a35314d14997 tempest-ServersTestJSON-1301996404 tempest-ServersTestJSON-1301996404-project-member] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1387.895793] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGHEST for action security_group_members [ 1387.896223] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.896350] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.896418] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.896616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.896762] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.896858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.896919] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.897078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.897163] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.897272] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.985759] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.985988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.985988] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.986178] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.986264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.986450] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.986546] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.986605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.986744] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.986817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.986898] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1388.022282] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.022507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.022507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.022681] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.022819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.039730] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1388.065393] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.065611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.065611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.065913] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.078881] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1388.079858] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.081087] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1388.128022] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.128276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.128276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.128464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.143302] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.144151] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1388.144228] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1388.144322] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1388.189084] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.189266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.189320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.189564] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.190968] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.191166] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1388.278348] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.278783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.278783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.278783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.279101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.279414] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1388.399419] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.399591] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.399761] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.399896] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.403461] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.403608] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.403658] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.404047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.404188] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.404504] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1388.404601] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8062fa1b-833d-41ea-83be-2da29f1463e8', '3042d77c-efdf-4ff4-8800-d0a920f9e548', '47f32cb1-135b-4397-8ab9-34d019c13eaf', '22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d', '04e3d21c-6754-446b-b0ca-61b5ed8f6a3b', '15353240-f696-445d-9f9f-291a69a12406', 'fa9bf74b-89b9-48d3-b394-0eb584bf5c54', 'fd672f3d-6117-44aa-8b2f-40dde93f9373', '2904b768-7fb4-4263-a1a8-2deb76da7f25', '94ac6b18-4924-425a-a674-ac5343806fa2', 'e5b339ac-01aa-4f28-9e73-9f48477e571d', 'ad542a16-77ff-4002-b217-5630a01b6f17', '046b28ff-80bf-405a-859e-0080bd4c492a', '07b5dcdc-e0c4-4d5a-9f24-d000aad5b631', '743c5a69-4fa0-4875-ab4b-14b45b31c03c', '2d9d9765-c2f1-49df-8133-e3911f01267b', 'ef83d33e-bb76-4bd8-9c91-f6567ebf6c19', '05fe27ed-0f48-4824-843a-cb10730b7531', 'e9c7c205-f0b9-4a7b-b88d-839171878ae3', 'ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15', '085ff348-1812-4078-9ad5-3958496f698b', '3990baf0-9e24-4b70-8c31-60cf273fe344', 'd97c0b7d-58d1-4baf-97be-f3a035518398', '8e8e18e2-41de-44dd-a97f-655de1cca16f', '0a32a98c-e183-4d24-a064-a30e3d8451a7', 'fa6250d1-4a11-4b07-8308-040a7f86026a', 'e6efcb92-8e15-4172-8949-8449dfa15fb3', '159662e6-8d8b-459e-af18-9590760ed457', 'bbdddd19-b5d8-4409-9731-8dacfc9c1c1a', '2af4f432-9b80-40ee-9230-997d5fd46f40', '79256018-f240-48eb-94f9-bc8b0119d8f5', 'c5c06941-63aa-4b49-b9e8-da02d464ab8f', 'e17851c9-16c9-44ea-b660-c316b983e92e', '84a2d82b-f4e1-4a80-9ae0-5e6bc5d628cd', '3e4062aa-2f69-4b3d-8c17-d03ee84455ba', 'dbbd5a6a-d11b-47e8-a835-6b824a5963a5', '2a9aad73-83b3-40ec-b675-e69c4f59ba9f', '08b51b44-1df0-4a96-9da8-8c013955ee0d', '4e1cfb97-2b8b-4c03-b3bb-d47979f0434e', '7823ce5a-b26b-47ed-b253-093353398a68', 'dad04559-d224-486f-adbe-3d9a2df06d0a', '698ff167-530f-4085-8a98-c574783d5ed9', '80a77268-fa72-46b8-ba25-eed73b0ba36a', 'ea1a19d6-ac31-4e61-b250-037c90dc02d6', 'c86f328f-f619-4559-ae86-8793a284cfe3', 'b6a73361-0065-4c2b-847b-544a63c06efc', '10e0d2a4-e42f-49c4-b693-268f72e54b08', 'c9813fef-8c97-4cb6-92ff-4d01107ef382'} {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1388.404717] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1388.427128] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.427128] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.427294] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.427390] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.427436] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.427533] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1388.427601] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1388.427668] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1388.431885] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.431885] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.432080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.432080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.432242] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.432324] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.432412] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be updated. [ 1388.458981] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.459151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.459223] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.459518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.459660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.468105] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: IN_PROGRESS for 2s [ 1388.520722] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.520969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.520969] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.521168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.522255] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.522510] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1388.522588] env[65899]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65899) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1388.522661] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1388.522725] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1388.522800] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1388.522868] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGH for action security_group_rules [ 1388.522944] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGH for action security_group_rules [ 1388.523023] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGH for action security_group_rules [ 1388.523089] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGH for action security_group_rules [ 1388.523151] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGH for action security_group_rules [ 1388.523211] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGH for action security_group_rules [ 1388.523271] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGH for action security_group_rules [ 1388.523330] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGH for action security_group_rules [ 1388.523391] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGH for action security_group_rules [ 1388.523452] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGH for action security_group_rules [ 1388.523511] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGH for action security_group_rules [ 1388.523570] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGH for action security_group_rules [ 1388.523629] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGH for action security_group_rules [ 1388.523689] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGH for action security_group_rules [ 1388.523749] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGH for action security_group_rules [ 1388.523808] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGH for action security_group_rules [ 1388.523868] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGH for action security_group_rules [ 1388.523928] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGH for action security_group_rules [ 1388.523987] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGH for action security_group_rules [ 1388.524058] env[65899]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGH for action security_group_rules [ 1388.524151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.051067] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1390.051067] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a deletion is rescheduled due to dependency. [ 1390.051487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.480894] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15353240-f696-445d-9f9f-291a69a12406 in Status: SUCCESS [ 1390.481132] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15353240-f696-445d-9f9f-291a69a12406 deletion is rescheduled due to dependency. [ 1390.481267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.885794] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.886145] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.886145] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.886658] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.886658] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.886827] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.886884] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.887110] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.887258] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.887488] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1391.887604] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1391.887709] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1391.887816] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1391.887921] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1391.888032] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1391.888163] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1391.906191] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1391.906353] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1391.906480] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1391.906646] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-653" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.906939] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-dde71f88-f0d2-4275-b479-c8f1a540854a taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.907116] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.907230] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.907539] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.907676] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde71f88-f0d2-4275-b479-c8f1a540854a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.410186] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.410440] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.410502] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.410785] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.410931] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.411237] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.411396] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.411510] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.411730] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.411861] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.412157] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.412420] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.412585] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.412806] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.412942] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.413093] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: dde71f88-f0d2-4275-b479-c8f1a540854a is going to be updated. [ 1392.438078] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.438325] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.438409] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.438683] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.438871] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.439103] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.897509] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.897801] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1392.897801] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 with Priority: HIGH for action security_group_rules [ 1392.897801] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf with Priority: HIGH for action security_group_rules [ 1392.897933] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 with Priority: HIGH for action security_group_rules [ 1392.898020] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c with Priority: HIGH for action security_group_rules [ 1392.898126] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 with Priority: HIGH for action security_group_rules [ 1392.898220] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 with Priority: HIGH for action security_group_rules [ 1392.898312] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGH for action security_group_rules [ 1392.898402] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 with Priority: HIGH for action security_group_rules [ 1392.898492] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 with Priority: HIGH for action security_group_rules [ 1392.898587] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d9d9765-c2f1-49df-8133-e3911f01267b with Priority: HIGH for action security_group_rules [ 1392.898675] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046b28ff-80bf-405a-859e-0080bd4c492a with Priority: HIGH for action security_group_rules [ 1392.898766] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad542a16-77ff-4002-b217-5630a01b6f17 with Priority: HIGH for action security_group_rules [ 1392.898855] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5b339ac-01aa-4f28-9e73-9f48477e571d with Priority: HIGH for action security_group_rules [ 1392.898942] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ac6b18-4924-425a-a674-ac5343806fa2 with Priority: HIGH for action security_group_rules [ 1392.899040] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 with Priority: HIGH for action security_group_rules [ 1392.899129] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15353240-f696-445d-9f9f-291a69a12406 with Priority: HIGH for action security_group_rules [ 1392.899216] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 with Priority: HIGH for action security_group_rules [ 1392.899303] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b with Priority: HIGH for action security_group_rules [ 1392.899422] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 with Priority: HIGH for action security_group_rules [ 1392.899519] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d with Priority: HIGH for action security_group_rules [ 1392.899869] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8062fa1b-833d-41ea-83be-2da29f1463e8 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.899998] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.900073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.900286] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.900390] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8062fa1b-833d-41ea-83be-2da29f1463e8',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.901438] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47f32cb1-135b-4397-8ab9-34d019c13eaf taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.901566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.901566] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.901696] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.901800] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47f32cb1-135b-4397-8ab9-34d019c13eaf',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.903236] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.903236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.903236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.903236] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.903709] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa9bf74b-89b9-48d3-b394-0eb584bf5c54',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.903968] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.904088] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.904152] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.904301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.904379] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('743c5a69-4fa0-4875-ab4b-14b45b31c03c',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.905042] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.905153] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.905210] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.905352] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.905423] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.906202] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.906328] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.906386] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.906507] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.906580] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c7c205-f0b9-4a7b-b88d-839171878ae3',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.907414] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.907516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.907555] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.907698] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.907762] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.908448] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.909073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.909073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.909073] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.909073] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef83d33e-bb76-4bd8-9c91-f6567ebf6c19',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.909452] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.909571] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.909627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.909790] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.909862] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07b5dcdc-e0c4-4d5a-9f24-d000aad5b631',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.910530] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d9d9765-c2f1-49df-8133-e3911f01267b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.910721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.910788] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.910933] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.911222] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d9d9765-c2f1-49df-8133-e3911f01267b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.911936] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-046b28ff-80bf-405a-859e-0080bd4c492a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.911936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.911936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.912121] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.912121] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('046b28ff-80bf-405a-859e-0080bd4c492a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.912778] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad542a16-77ff-4002-b217-5630a01b6f17 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.912778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.912915] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.912985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.913067] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad542a16-77ff-4002-b217-5630a01b6f17',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.913762] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5b339ac-01aa-4f28-9e73-9f48477e571d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.913845] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.913883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.914072] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.914137] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5b339ac-01aa-4f28-9e73-9f48477e571d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.914814] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94ac6b18-4924-425a-a674-ac5343806fa2 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.914926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.914970] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.915703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.915703] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94ac6b18-4924-425a-a674-ac5343806fa2',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.915819] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2904b768-7fb4-4263-a1a8-2deb76da7f25 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.915917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.915981] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.916145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.917034] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2904b768-7fb4-4263-a1a8-2deb76da7f25',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.917034] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15353240-f696-445d-9f9f-291a69a12406 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.917034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.917034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.917272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.917272] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15353240-f696-445d-9f9f-291a69a12406',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.917974] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd672f3d-6117-44aa-8b2f-40dde93f9373 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.918108] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.918150] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.918451] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.918451] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd672f3d-6117-44aa-8b2f-40dde93f9373',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.919071] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.919208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.919270] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.919460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.919534] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04e3d21c-6754-446b-b0ca-61b5ed8f6a3b',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.920183] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3042d77c-efdf-4ff4-8800-d0a920f9e548 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.920305] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.920365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.920496] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.920554] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3042d77c-efdf-4ff4-8800-d0a920f9e548',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.921520] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.921520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.921520] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.921775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.921775] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.949776] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.949776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.949776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.949776] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.951803] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.951803] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.954814] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.954814] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.973743] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.973743] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 743c5a69-4fa0-4875-ab4b-14b45b31c03c is going to be deleted. [ 1392.974816] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.975027] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.992670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.992832] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c7c205-f0b9-4a7b-b88d-839171878ae3 is going to be deleted. [ 1392.993685] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.993892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.012457] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.012606] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15 is going to be deleted. [ 1393.028195] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.028379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.028445] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.028647] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.028735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.028902] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-743c5a69-4fa0-4875-ab4b-14b45b31c03c" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.042840] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.042993] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.043101] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.043264] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.043359] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.043464] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c7c205-f0b9-4a7b-b88d-839171878ae3" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.096516] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.096778] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.096963] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.097131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.097272] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.097442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea2dc0f7-b6a6-4d62-8c03-965e21dd1f15" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.157940] env[65899]: INFO networking_nsxv3.common.synchronization [req-8b273820-b16a-425b-a763-82c93bdc2664 req-b352b371-93a7-41dc-9332-c0f9a26887d7 service nova] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 1393.158374] env[65899]: INFO networking_nsxv3.common.synchronization [req-8b273820-b16a-425b-a763-82c93bdc2664 req-b352b371-93a7-41dc-9332-c0f9a26887d7 service nova] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1393.158374] env[65899]: INFO networking_nsxv3.common.synchronization [req-8b273820-b16a-425b-a763-82c93bdc2664 req-b352b371-93a7-41dc-9332-c0f9a26887d7 service nova] Enqueued Resource ID: dde71f88-f0d2-4275-b479-c8f1a540854a with Priority: HIGHEST for action port [ 1393.159027] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_rules [ 1393.159110] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1393.159249] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde71f88-f0d2-4275-b479-c8f1a540854a with Priority: HIGHEST for action port [ 1393.159636] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.159783] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.159827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.160023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.160103] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.161098] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.161217] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.161282] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.161532] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.161602] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.161840] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.161967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.165516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.165516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.165516] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.165516] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde71f88-f0d2-4275-b479-c8f1a540854a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.165516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.165516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.165516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.165516] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde71f88-f0d2-4275-b479-c8f1a540854a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.424015] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.424311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.424311] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.424419] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.424588] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.424671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.424732] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.424880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.424962] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.425058] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.425147] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.464985] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.465273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.465273] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.465379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.479468] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.479678] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.480395] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.480488] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.483651] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.483756] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.491759] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.491861] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.492758] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.492881] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.493739] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.493875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.494780] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.494926] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.495629] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.495731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.496571] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.496672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.500506] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.500633] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.501290] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1393.502042] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.502042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.502559] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1393.502976] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.503104] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.503790] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1393.504460] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.504460] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.505056] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1393.505504] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.505627] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.506347] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1393.506811] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.506969] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47f32cb1-135b-4397-8ab9-34d019c13eaf is going to be deleted. [ 1393.508647] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.508734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.508801] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.508994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.530327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.530570] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d9d9765-c2f1-49df-8133-e3911f01267b is going to be deleted. [ 1393.531680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.531886] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.551375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.551543] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5b339ac-01aa-4f28-9e73-9f48477e571d is going to be deleted. [ 1393.553616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.553616] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.574703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.574922] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd672f3d-6117-44aa-8b2f-40dde93f9373 is going to be deleted. [ 1393.575746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.576023] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.577456] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.577579] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.578532] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.578629] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.598042] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.598042] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad542a16-77ff-4002-b217-5630a01b6f17 is going to be deleted. [ 1393.598611] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.598817] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.611660] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.611852] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.618477] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.618612] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2904b768-7fb4-4263-a1a8-2deb76da7f25 is going to be deleted. [ 1393.619670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.619922] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.638693] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.638994] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.643061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.643243] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 046b28ff-80bf-405a-859e-0080bd4c492a is going to be deleted. [ 1393.644147] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.644358] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.665237] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.665443] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.665663] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.665765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.665922] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.666985] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dde71f88-f0d2-4275-b479-c8f1a540854a with status ACTIVE [ 1393.667097] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.667165] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.667239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.667557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.667557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.667722] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.667823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.667884] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.671911] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.672022] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.672171] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.672279] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.672340] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.672511] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.672584] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.672666] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dde71f88-f0d2-4275-b479-c8f1a540854a is going to be updated. [ 1393.693909] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.694085] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef83d33e-bb76-4bd8-9c91-f6567ebf6c19 is going to be deleted. [ 1393.694997] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.695267] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.695318] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.695403] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15353240-f696-445d-9f9f-291a69a12406 is going to be deleted. [ 1393.696799] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.696910] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.696960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.697151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.697234] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.697355] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2904b768-7fb4-4263-a1a8-2deb76da7f25" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.697486] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.697637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.699366] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.699528] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.699595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.699752] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.699880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.700035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde71f88-f0d2-4275-b479-c8f1a540854a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.763823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.764993] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04e3d21c-6754-446b-b0ca-61b5ed8f6a3b is going to be deleted. [ 1393.765606] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.765954] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.768088] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.768194] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.821459] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.821728] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07b5dcdc-e0c4-4d5a-9f24-d000aad5b631 is going to be deleted. [ 1393.822660] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.822914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.847825] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.848043] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.848698] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.848901] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.860347] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.860559] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94ac6b18-4924-425a-a674-ac5343806fa2 is going to be deleted. [ 1393.861822] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.862071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.926145] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.926540] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3042d77c-efdf-4ff4-8800-d0a920f9e548 is going to be deleted. [ 1393.927219] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.927442] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.928346] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.952167] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.952387] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.987946] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.988156] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.988927] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.989058] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa9bf74b-89b9-48d3-b394-0eb584bf5c54 is going to be deleted. [ 1393.989986] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.990211] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.062418] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.062688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.063985] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.064137] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8062fa1b-833d-41ea-83be-2da29f1463e8 is going to be deleted. [ 1394.065013] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.065229] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.065320] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.065431] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47f32cb1-135b-4397-8ab9-34d019c13eaf" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.065586] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.065745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.065824] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.065929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d9d9765-c2f1-49df-8133-e3911f01267b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.066538] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.067050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.067050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.067050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5b339ac-01aa-4f28-9e73-9f48477e571d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.067050] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.067281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.067281] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.067403] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd672f3d-6117-44aa-8b2f-40dde93f9373" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.067454] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.067644] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.067739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.067879] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad542a16-77ff-4002-b217-5630a01b6f17" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.068385] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.068557] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.083399] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.083630] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.103545] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.103839] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d is going to be deleted. [ 1394.104894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.105146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.105241] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.105396] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-046b28ff-80bf-405a-859e-0080bd4c492a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.105581] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.105765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.105843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.105980] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef83d33e-bb76-4bd8-9c91-f6567ebf6c19" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.106549] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.106745] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.106849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.106979] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15353240-f696-445d-9f9f-291a69a12406" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.107131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.107298] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.107417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.107516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04e3d21c-6754-446b-b0ca-61b5ed8f6a3b" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.107683] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.107843] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.107923] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.108061] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07b5dcdc-e0c4-4d5a-9f24-d000aad5b631" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.108304] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.108478] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.108556] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.108703] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94ac6b18-4924-425a-a674-ac5343806fa2" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.108802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.108960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.109045] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.109168] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3042d77c-efdf-4ff4-8800-d0a920f9e548" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.133446] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.133688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.133688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.133868] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.133948] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.134088] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa9bf74b-89b9-48d3-b394-0eb584bf5c54" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.174659] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.220479] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.220731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.220731] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.220916] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.221017] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.221146] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8062fa1b-833d-41ea-83be-2da29f1463e8" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.253734] env[65899]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1394.253734] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.253734] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.254037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.254037] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.254132] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.254171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22ffb13c-eb96-4d92-a3c7-e5cef4ddc34d" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.430539] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05fe27ed-0f48-4824-843a-cb10730b7531: rpc.has_security_group_logging(os_id): False [ 1394.448710] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.448875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.448875] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.449086] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.470518] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.470856] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.470978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.471054] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.471261] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.471344] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.471430] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05fe27ed-0f48-4824-843a-cb10730b7531 is going to be updated. [ 1394.530932] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.531177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.531177] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.531372] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.531513] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.544623] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05fe27ed-0f48-4824-843a-cb10730b7531 in Status: IN_PROGRESS for 2s [ 1394.677692] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.677955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.677955] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.678252] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.678417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.678575] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1394.708875] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.709114] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.709174] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.709453] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.709645] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.719417] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1396.559383] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05fe27ed-0f48-4824-843a-cb10730b7531 in Status: SUCCESS [ 1396.559383] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.730682] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1396.730883] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.730972] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.731289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.731521] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.731646] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.731724] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.731878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.731961] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.732066] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.732151] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.234701] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.737224] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d97c0b7d-58d1-4baf-97be-f3a035518398: rpc.has_security_group_logging(os_id): False [ 1397.755375] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.755582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.755582] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.755836] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.780299] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.780728] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.780871] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.780959] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.781160] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.781266] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.781365] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1397.833769] env[65899]: INFO networking_nsxv3.common.synchronization [req-e20ee3c9-2cd2-4a20-aa6f-aa87fb49da14 req-61521f08-5bd8-4ba6-b27e-fe435f24ffa0 tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1397.834880] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1397.834880] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.834880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.834880] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.835470] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.835672] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.835856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.835856] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.835989] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.836111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.836227] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.877561] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.877672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.877672] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.877862] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.878025] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.896684] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1398.163984] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.164157] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.164157] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.164394] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.164683] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.164865] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.164983] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.165403] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.165553] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.165774] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1398.165887] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1398.165995] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1398.166114] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1398.166225] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1398.166373] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1398.166553] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1398.187296] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1398.187460] env[65899]: DEBUG dogpile.cache.region [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1398.187600] env[65899]: DEBUG dogpile.lock [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1398.187801] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "network-731" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.188296] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.188564] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.188707] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.189080] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.189222] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('540e9157-7e93-4de7-bf7e-ed9a5f9c9608',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.339061] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.339284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.339284] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.339631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.395725] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.396076] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.396208] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.396277] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.396485] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.396567] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.396659] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1398.437341] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.437711] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.437914] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.438346] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.438680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.450490] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1398.691863] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.692139] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.692229] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.692550] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.692736] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.692894] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Segment Port 540e9157-7e93-4de7-bf7e-ed9a5f9c9608 not found, creating... [ 1398.693175] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.693337] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.693451] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.693683] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.693818] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.694111] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.694265] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.694379] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.694586] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.694719] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.694856] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Resource: SegmentPort with ID: 540e9157-7e93-4de7-bf7e-ed9a5f9c9608 is going to be created. [ 1398.719074] env[65899]: DEBUG networking_nsxv3.common.locking [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.719389] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.719596] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.719909] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.720262] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.720505] env[65899]: DEBUG oslo_concurrency.lockutils [None req-7a5c0bca-66ca-4519-b4c5-2ac3d502596c None None] Releasing lock "port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.418596] env[65899]: INFO networking_nsxv3.common.synchronization [req-e20ee3c9-2cd2-4a20-aa6f-aa87fb49da14 req-fb183aa9-0c60-4068-8d96-29fb0e074072 service nova] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 1399.419035] env[65899]: INFO networking_nsxv3.common.synchronization [req-e20ee3c9-2cd2-4a20-aa6f-aa87fb49da14 req-fb183aa9-0c60-4068-8d96-29fb0e074072 service nova] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1399.419431] env[65899]: INFO networking_nsxv3.common.synchronization [req-e20ee3c9-2cd2-4a20-aa6f-aa87fb49da14 req-fb183aa9-0c60-4068-8d96-29fb0e074072 service nova] Enqueued Resource ID: 540e9157-7e93-4de7-bf7e-ed9a5f9c9608 with Priority: HIGHEST for action port [ 1399.420269] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_rules [ 1399.420492] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1399.420629] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540e9157-7e93-4de7-bf7e-ed9a5f9c9608 with Priority: HIGHEST for action port [ 1399.421019] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.421203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.421301] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.421965] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.422060] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.423257] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.423395] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.423692] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.423826] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.423918] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.424196] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.424314] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('540e9157-7e93-4de7-bf7e-ed9a5f9c9608',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.913936] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1399.914205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.926879] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.927111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.928460] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 540e9157-7e93-4de7-bf7e-ed9a5f9c9608 with status ACTIVE [ 1399.928750] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.928895] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.928939] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.929181] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.929268] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.929439] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.929690] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.929765] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.930047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.930047] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.930278] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.930379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.930446] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.930628] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.930709] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.930800] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 540e9157-7e93-4de7-bf7e-ed9a5f9c9608 is going to be updated. [ 1399.951975] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.952206] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.952206] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.952427] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.952595] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.952809] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-540e9157-7e93-4de7-bf7e-ed9a5f9c9608" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.460306] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1400.460775] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a deletion is rescheduled due to dependency. [ 1400.460775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.460775] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.460984] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.461163] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.461275] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.461336] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.461483] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.461563] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.461653] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.964023] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.466073] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.968655] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.968864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.968864] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.969640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.969640] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.969640] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1402.004043] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.004280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.004280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.004552] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.004705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.013686] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1404.025922] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1404.026389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.026389] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.026516] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.026670] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1404.026789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1404.026854] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1404.027032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1404.027116] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.027201] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.027292] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1404.421862] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.422096] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1404.529887] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.032121] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80a77268-fa72-46b8-ba25-eed73b0ba36a: rpc.has_security_group_logging(os_id): False [ 1405.050036] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.050293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.050293] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.050469] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.050562] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.050819] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.050944] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.051032] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.051204] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.051289] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.051390] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1405.149861] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.150134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.150134] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.150375] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.150534] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.169402] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1407.184842] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1407.185249] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.449678] env[65899]: INFO networking_nsxv3.common.synchronization [req-9643b0c2-5fbb-4ed1-90aa-d6f02480ae04 req-5d566ee8-fff4-4383-acdd-15edb118f654 tempest-ServerActionsTestOtherB-1521776614 tempest-ServerActionsTestOtherB-1521776614-project-member] Enqueued Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1408.450385] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d97c0b7d-58d1-4baf-97be-f3a035518398 with Priority: HIGHEST for action security_group_members [ 1408.451033] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-d97c0b7d-58d1-4baf-97be-f3a035518398 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.451167] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.451214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.451409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.451563] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.451659] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.451719] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.451859] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.451941] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.452048] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d97c0b7d-58d1-4baf-97be-f3a035518398',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.954269] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.954415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.954481] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.954688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.954782] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.954986] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.955105] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.955184] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.955364] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.955450] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.955537] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 is going to be updated. [ 1408.988922] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.989296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.989296] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.989472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.989472] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.997776] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: IN_PROGRESS for 2s [ 1411.009833] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d97c0b7d-58d1-4baf-97be-f3a035518398 in Status: SUCCESS [ 1411.010227] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d97c0b7d-58d1-4baf-97be-f3a035518398 deletion is rescheduled due to dependency. [ 1411.010227] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d97c0b7d-58d1-4baf-97be-f3a035518398" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.452324] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.452578] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.453771] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.453771] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.212767] env[65899]: INFO networking_nsxv3.common.synchronization [req-de17e672-56de-4664-97bc-3708fc57eae1 req-7d7e7fce-b424-4f4c-ba0b-13ff441d0c66 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_members [ 1421.213324] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05fe27ed-0f48-4824-843a-cb10730b7531 with Priority: HIGHEST for action security_group_members [ 1421.213639] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-05fe27ed-0f48-4824-843a-cb10730b7531 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.213762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.213830] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.214170] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.214351] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.214512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.214512] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.214667] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.214751] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.214844] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05fe27ed-0f48-4824-843a-cb10730b7531',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.717172] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.717366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.717366] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.717594] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.717739] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.717870] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.717957] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.718034] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.718179] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.718251] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.718336] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05fe27ed-0f48-4824-843a-cb10730b7531 is going to be updated. [ 1421.748557] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.748763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.748763] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.748956] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.749111] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.757542] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05fe27ed-0f48-4824-843a-cb10730b7531 in Status: IN_PROGRESS for 2s [ 1423.767788] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05fe27ed-0f48-4824-843a-cb10730b7531 in Status: SUCCESS [ 1423.768183] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05fe27ed-0f48-4824-843a-cb10730b7531 deletion is rescheduled due to dependency. [ 1423.768183] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05fe27ed-0f48-4824-843a-cb10730b7531" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.876716] env[65899]: INFO networking_nsxv3.common.synchronization [None req-6e9689a4-7ae7-4b75-b0d2-2c18f25d71a3 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_rules [ 1425.877181] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_rules [ 1425.877479] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5324a477-2dc3-41df-b728-1b57afa53f34 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.877601] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.877688] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.877943] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.878040] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.959651] env[65899]: INFO networking_nsxv3.common.synchronization [None req-389ba554-b7f9-47f1-8f21-3ceac5505ab6 tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_rules [ 1425.960221] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_rules [ 1425.960524] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5324a477-2dc3-41df-b728-1b57afa53f34 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.960625] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.398527] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.398671] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.398721] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.398925] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.399016] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.399109] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5324a477-2dc3-41df-b728-1b57afa53f34 already deleted. [ 1426.399189] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.399334] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.399501] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.399588] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1426.919176] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1426.919560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1426.919560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1426.919560] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1426.919686] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1426.919719] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5324a477-2dc3-41df-b728-1b57afa53f34 already deleted. [ 1426.919849] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.961644] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.961963] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.276244] env[65899]: INFO networking_nsxv3.common.synchronization [req-59181033-02c4-45bb-92a0-1b63bc65c161 req-3b5f0658-9e6c-4b25-9d2d-1237d923e40e tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_members [ 1431.276588] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_members [ 1431.276890] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-5324a477-2dc3-41df-b728-1b57afa53f34 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.277015] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.277226] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.277487] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.277644] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.277762] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.277821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.277978] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.278078] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.278212] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.525676] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock network-443 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.525878] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.526012] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.526280] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.526523] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.526672] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.526785] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.526995] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.527147] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.527350] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1431.527460] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] NeedRegenerationException {{(pid=65899) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1431.527565] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] no value, waiting for create lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1431.527668] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] value creation lock acquired {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1431.527795] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] No value present for key: 'zone-id' {{(pid=65899) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1431.527904] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Calling creation function for not-yet-present value {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1431.528041] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1431.548455] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1431.548675] env[65899]: DEBUG dogpile.cache.region [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65899) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1431.548783] env[65899]: DEBUG dogpile.lock [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Released creation lock {{(pid=65899) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1431.548914] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "network-443" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.549264] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock port-007b3be1-05ed-44f4-9c3a-1151c11a9099 taken with stack trace [, , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.549435] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "port-007b3be1-05ed-44f4-9c3a-1151c11a9099" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.549548] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "port-007b3be1-05ed-44f4-9c3a-1151c11a9099" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.549918] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "port-007b3be1-05ed-44f4-9c3a-1151c11a9099" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.550077] env[65899]: DEBUG networking_nsxv3.api.rpc [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('007b3be1-05ed-44f4-9c3a-1151c11a9099',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.780784] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.780982] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.781057] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.781240] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.781330] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.781518] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.781618] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.781680] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.781823] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.781900] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.781980] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5324a477-2dc3-41df-b728-1b57afa53f34 already deleted. [ 1431.782071] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.052489] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.052853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.052853] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.053076] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.053251] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.053447] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Segment Port 007b3be1-05ed-44f4-9c3a-1151c11a9099 not found, creating... [ 1432.053720] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.053879] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.054029] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.054265] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.054405] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.054728] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.054904] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.055036] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.055270] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.055392] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.055524] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Resource: SegmentPort with ID: 007b3be1-05ed-44f4-9c3a-1151c11a9099 is going to be created. [ 1432.080479] env[65899]: DEBUG networking_nsxv3.common.locking [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.080716] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.080866] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.081128] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.081357] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.081563] env[65899]: DEBUG oslo_concurrency.lockutils [None req-07e8e759-c06e-479f-a9bf-44e96d064b98 None None] Releasing lock "port-007b3be1-05ed-44f4-9c3a-1151c11a9099" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.748112] env[65899]: INFO networking_nsxv3.common.synchronization [req-59181033-02c4-45bb-92a0-1b63bc65c161 req-315908f6-16ab-4bc0-a926-b7db0d2eedfa service nova] Enqueued Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_rules [ 1432.748296] env[65899]: INFO networking_nsxv3.common.synchronization [req-59181033-02c4-45bb-92a0-1b63bc65c161 req-315908f6-16ab-4bc0-a926-b7db0d2eedfa service nova] Enqueued Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_members [ 1432.748431] env[65899]: INFO networking_nsxv3.common.synchronization [req-59181033-02c4-45bb-92a0-1b63bc65c161 req-315908f6-16ab-4bc0-a926-b7db0d2eedfa service nova] Enqueued Resource ID: 007b3be1-05ed-44f4-9c3a-1151c11a9099 with Priority: HIGHEST for action port [ 1432.748932] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_rules [ 1432.749080] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_members [ 1432.749176] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007b3be1-05ed-44f4-9c3a-1151c11a9099 with Priority: HIGHEST for action port [ 1432.749443] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5324a477-2dc3-41df-b728-1b57afa53f34 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.749593] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.749637] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.750080] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.750167] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.751006] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-5324a477-2dc3-41df-b728-1b57afa53f34 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.751137] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.751205] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.751377] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.751525] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.751619] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.751679] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.751819] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.751903] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.751989] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.753058] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock port-007b3be1-05ed-44f4-9c3a-1151c11a9099 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.753169] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-007b3be1-05ed-44f4-9c3a-1151c11a9099" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.753231] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-007b3be1-05ed-44f4-9c3a-1151c11a9099" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.753379] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-007b3be1-05ed-44f4-9c3a-1151c11a9099" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.753469] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('007b3be1-05ed-44f4-9c3a-1151c11a9099',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.255401] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.256796] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-5324a477-2dc3-41df-b728-1b57afa53f34 taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.256953] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.258557] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 007b3be1-05ed-44f4-9c3a-1151c11a9099 with status ACTIVE [ 1433.258762] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.258878] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.258936] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.259133] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.259221] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.259393] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.259484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.259542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.259695] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.259764] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.260020] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.260131] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.260195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.260327] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.260406] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.260509] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 007b3be1-05ed-44f4-9c3a-1151c11a9099 is going to be updated. [ 1433.282162] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.282365] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.282409] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.282599] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.282735] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.282894] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-007b3be1-05ed-44f4-9c3a-1151c11a9099" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.758421] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.261663] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.262081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.262081] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.262171] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.262259] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.262359] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5324a477-2dc3-41df-b728-1b57afa53f34 is going to be created. [ 1434.285186] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.285398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.285398] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.285589] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.285746] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.295012] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5324a477-2dc3-41df-b728-1b57afa53f34 in Status: UNINITIALIZED for 2s [ 1436.306647] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5324a477-2dc3-41df-b728-1b57afa53f34 in Status: SUCCESS [ 1436.307035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.307035] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.307203] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.307425] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.307542] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.307605] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.307794] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.307929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.307929] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.308026] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.810545] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.312752] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5324a477-2dc3-41df-b728-1b57afa53f34: rpc.has_security_group_logging(os_id): False [ 1437.329717] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.329960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.329960] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.330195] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.330280] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.330518] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.330617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.330677] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.330821] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.330917] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.331052] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5324a477-2dc3-41df-b728-1b57afa53f34 is going to be created. [ 1437.390382] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.390617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.390617] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.390789] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.390967] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.403313] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5324a477-2dc3-41df-b728-1b57afa53f34 in Status: IN_PROGRESS for 2s [ 1437.749980] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.750188] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1439.416325] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5324a477-2dc3-41df-b728-1b57afa53f34 in Status: SUCCESS [ 1439.416760] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.752487] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.752806] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.753970] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.754351] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.754881] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.755271] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.755906] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.756309] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.457133] env[65899]: INFO networking_nsxv3.common.synchronization [req-7871e1f2-323b-431e-86b3-354a91e40602 req-bef355a8-33d6-4391-88ac-a89864c4ac6e tempest-ServerActionsTestJSON-1819588824 tempest-ServerActionsTestJSON-1819588824-project-member] Enqueued Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1459.457567] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a with Priority: HIGHEST for action security_group_members [ 1459.457904] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-80a77268-fa72-46b8-ba25-eed73b0ba36a taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.458235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.458235] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.458429] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.458497] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.458580] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.458670] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.458827] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.458935] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.459020] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80a77268-fa72-46b8-ba25-eed73b0ba36a',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.962415] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.962415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.962415] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.962705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.962705] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.962780] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.962892] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.962990] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.963173] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.963239] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.963329] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a is going to be updated. [ 1459.995243] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.995468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.995468] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.995655] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.995777] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.004815] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: IN_PROGRESS for 2s [ 1462.015284] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a in Status: SUCCESS [ 1462.015704] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80a77268-fa72-46b8-ba25-eed73b0ba36a deletion is rescheduled due to dependency. [ 1462.015704] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80a77268-fa72-46b8-ba25-eed73b0ba36a" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.458750] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.459028] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.460103] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.460103] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.461332] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.461852] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1479.462621] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.463064] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.463925] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.464325] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.465658] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.466032] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.467077] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.467549] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.073727] env[65899]: INFO networking_nsxv3.common.synchronization [req-36bd2224-7792-46fe-a9f8-b5f261f892fb req-121f231d-5fed-49bb-ba58-447b1df3462f tempest-AttachVolumeNegativeTest-1004311805 tempest-AttachVolumeNegativeTest-1004311805-project-member] Enqueued Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_members [ 1497.074291] env[65899]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5324a477-2dc3-41df-b728-1b57afa53f34 with Priority: HIGHEST for action security_group_members [ 1497.074589] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock member-5324a477-2dc3-41df-b728-1b57afa53f34 taken with stack trace [, , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.074715] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.074802] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.074971] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.075132] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.075220] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.075276] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.075417] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.075692] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.075813] env[65899]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5324a477-2dc3-41df-b728-1b57afa53f34',) {} {{(pid=65899) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.578605] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.578818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.578818] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.579039] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.579151] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.579326] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.579424] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.579484] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.579631] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.579707] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.579794] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5324a477-2dc3-41df-b728-1b57afa53f34 is going to be updated. [ 1497.608467] env[65899]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65899) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.608697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.608697] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.608891] env[65899]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.609044] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.618077] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5324a477-2dc3-41df-b728-1b57afa53f34 in Status: IN_PROGRESS for 2s [ 1499.628764] env[65899]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5324a477-2dc3-41df-b728-1b57afa53f34 in Status: SUCCESS [ 1499.629214] env[65899]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5324a477-2dc3-41df-b728-1b57afa53f34 deletion is rescheduled due to dependency. [ 1499.629214] env[65899]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5324a477-2dc3-41df-b728-1b57afa53f34" {{(pid=65899) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1502.074982] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.075406] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.076480] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1507.076480] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1512.077498] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.077861] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.078693] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.079138] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.080156] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.080569] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.081290] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.081658] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.082235] env[65899]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.082635] env[65899]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0